1/2 


AD-A147  110  METHGDQLOGV  FOR  MEASURING  THE  EFFICIENT  USE  OF 

AVAILABLE  RESOURCES  IN  AIR.  .  CU)  AIR  FORCE  INST  OF  TECH 
WRIGHT-PATTERSON  AFB  OH  SCHOOL  OF  SVST.  .  h  N  FISHER 
UNCLASSIFIED  SEP  84  AFIT/GEM/LSM/84S-8  F/G  5/1  NL 


>/ 


METHODOLOGY  FOR  MEASURING  THE  EFFICIENT 
USE  OF  AVAILABLE  RESOURCES  IN  AIR  FORCE 
CIVIL  ENGINEERING  ORGANIZATIONS 

THESIS 

Marvin  N.  Fisher 
First  Lieutenant,  USAF 

/.  r 

AFIT/GEM/LSM/84S-8 


DEPARTMENT  OF  THE  AIR  FORCE 
AIR  UNIVERSITY 


jELECTE 
,  NOV  0  2  1984 


AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 


Wright-Patterson  Air  Force  Base,  Ohio 

84  10  3®  031 


)  far  poUU  nlm 


AFIT/GEM/LSM/84 


METHODOLOGY  FOR  MEASURING  THE  EFFICIENT 
USE  OF  AVAILABLE  RESOURCES  IN  AIR  FORCE 
CIVIL  ENGINEERING  ORGANIZATIONS 

THESIS 

Marvin  N.  Fisher 
First  Lieutenant,  USAF 

AFIT/GEM/LSM/84S-8 


Approved  for  public  release;  distribution  unlimited 


The  contents  of  the  document  are  technically  accurate,  and  no 
sensitive  items,  detrimental  ideas,  or  deleterious  informa¬ 
tion  are  contained  therein.  Furthermore,  the  views  expressed 
in  the  document  are  those  of  the  author  and  do  not  necessarily 
reflect  the  views  of  the  School  of  Systems  and  Logistics,  the 
Air  University,  the  United  States  Air  Force,  or  the  Department 
of  Defense. 


security  classification  of  this  page 


la  REPORT  SECURITY  CLASSIFICATION 

UNCLASSIFIED 


2a  security  classification  authority 


REPORT  DOCUMENTATION  PAGE 


lb.  RESTRICTIVE  MARKINGS 


2b.  OECLASSIFICATION/OOWNGRAOING  SCHEDULE 


4.  PERFORMING  ORGANIZATION  REPORT  NUMSER(S) 

AFIT/GEM/LSM/84S-8 


3.  0 ISTRI BUT ION/AVAI LABILITY  OF  REPORT 

Approved  for  public  release; 
distribution  unlimited. 


9.  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 


6a  NAME  OF  PERFORMING  ORGANIZATION 

School  of  Systems  and 


b.  OFFICE  SYMBOL  7a  NAME  OF  MONITORING  ORGANIZATION 
(tf  appUeabia) 


AFIT/LS 


6c.  AOORESS  (City.  Stata  and  ZIP  Coda ) 

Air  Force  Institute  of  Technology 
Wright-Patterson  AFB  Oh  45433 


7b.  AOORESS  (City.  Stata  and  ZIP  Coda) 


Ba  NAME  OF  FUNOING/SFONSORING 
ORGANIZATION 


8b.  OFFICE  SYMBOL  9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  applicable) 


Ba  AOORESS  (City.  Stata  and  ZIP  Coda) 

1 10.  SOURCE  OF  FUNOING  NOS.  ] 

PROGRAM 
ELEMENT  NO. 

PROJECT 

NO. 

TASK 

NO. 

WORK  UNIT 
NO. 

11.  TITLE  ( inctuda  Security  Ctaaaiflcatioa) 

See  box  19.  . 

12.  PERSONAL  AUTHOR(S) 

Marvin N.  Fisher,  B.S.C.E.,  First  Lieutenant,  USAF 


13a  TYPE  OF  REPORT 

MS  Thesis 


13b.  TIME  COVEREO 
FROM _  TO 


1*.  DATE  OF  REPORT  <Yr„  Mo..  Day) 

1984  September 


19.  ABSTRACT  (Continue  on  rtMru  if  necessary  and  identify  tty  block  number ; 

Title:  METHODOLOGY  FOR  MEASURING  THE  EFFICIENT  USE  OF  AVAILABLE 
RESOURCES  IN  AIR  FORCE  CIVIL  ENGINEERING  ORGANIZATIONS 

Thesis  Chairman:  Thomas  H.  Gross,  Major,  USAF 


2a  OISTRIBUTION/AVAILASILITY  Of  ABSTRACT 
UNCLASSIFIEO/UN LIMITED  &  SAME  AS  RPT.  □  OTIC  USERS  □ 


22a  NAME  OF  RESPONSIBLE  INDIVIDUAL 

Thomas  H.  Gross,  Major,  USAF 


21.  ABSTRACT  SECURITY  CLASSIFICATION 

UNCLASSIFIED 


22b.  TELEPHONE  NUMBER 

i’Vi'ZS-XSa 


DO  FORM  1473, 33  APR 


EDITION  OF  1  JAN  73  IS  OBSOLETE. 


22c.  OFFICE  SYMBOL 

AFIT/DEM 


UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  PAGE 


UNCLASSIFIED 


SCCUHITY  CLASSIFICATION  OF  THIS  FAOC 


S  ft-  The  purpose  of  this  Kroooareh  effort  was  to  determine  if 
a  quantitative  model  of  the  efficient  use  of  available 
resources  could  be  developed  for  Base  Level  Civil 
Engineering  organizations.  Available  resources  included 
personnel,  material  supplies  and  vehicle  resources  and  was 
limited  to  those  resources  used  in  the  Operations  Branch. 

The  modeling  technique  used  in  this  research  effort  was  the 
Constrained  Facet  Analysis  (CFA)  which  can  evaluate  an 
organization  based  on  a  set  of  multiple  outputs  and  multiple 
inputs.  The  set  of  outputs  and  inputs  were  simultaneously 
evaluated  to  produce  one  effciency  rating  for  each 
organization  in  the  data  set.  The  model  also  identified  the 
relative  importance  of  each  output /input  variable  and 
identified  the  surplus  variables  causing  the  inefficient 
rating  in  the  inefficient  organizations.  The  analysis  was 
accomplished  by  collecting  data  from  the  civil  engineering 
organization  within  the  Tactical  Air  Command.  The  data  was 
analyzed  using  the  CFA  program  at  the  UnivjSrs-rt»?of  Texas  at 
Austin.  The  results  illustrated  that  the  efficient  use  of 
available  resources  could  be  modeled  using  the  CFA 
technique .  0  r  ■  ^  *  j !  3 ,  ,?  ,  ft#  ci  ^ v.cjM- clP  •  (~j  c,  j  <u  7  '< 


UNCLASSIFIED 


. . StCUFITY  CLASS.IFI.CATI.O.N  OF  THIJ  F4G6  . 


AFIT/GEM/LSM/84S-8 


METHODOLOGY  FOR  MEASURING  THE  EFFICIENT  USE  OF  AVAILABLE 
RESOURCES  IN  AIR  FORCE  CIVIL  ENGINEERING  ORGANIZATIONS 


THESIS 

Presented  to  the  Faculty  of  the  School  of  Systems  and  Logistics 
of  the  Air  Force  Institute  of  Technology 
Air  University 

In  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of 
Master  of  Science  in  Engineering  Management 


Marvin  N.  Fisher,  B.S. 
First  Lieutenant,  USAF 


September  1984 


Approved  for  public  release;  distribution  unlimited 


Acknowledgments 

The  author  wishes  to  express  his  sincere  thanks  to  his 
thesis  advisor.  Major  Thomas  H.  Gross,  of  the  School  of  Civil 
Engineering,  for  his  encouragement,  support  and  guidance. 

The  author  also  wishes  to  extend  his  grateful  appreciation 
to  his  thesis  reader,  Major  A1  Tucker,  for  his  suggestions 
and  support. 

Special  thanks  are  given  to  Major  Kochanek  and  Chief 
Master  Sergeant  Grueter,  HQ  TAC/DEMG  for  their  support  in 
providing  the  data  that  were  required  to  accomplish  this 
research  effort.  A  very  special  thanks  goes  to  Lieutenant 
Colonel  Terry  Clark,  of  the  School  of  Systems  and  Logistics, 
and  Doctors  Authella  and  Weilland  Bessent  of  the  University 
of  Texas  at  Austin  for  their  support  and  encouragement  in 
the  implementation  of  the  Constrained  Facet  Analysis  Model. 

The  author  is  especially  grateful  to  a  special  friend. 
First  Lieutenant  Timothy  Byers,  for  the  use  of  his  computer 
system.  Also,  the  author  is  extremenly  thankful  to  his 
typist  Linda  Byers,  for  her  outstanding  service. 

Finally,  the  author  wishes  to  thank  his  wife  Pamela  for 


her  understanding,  love  and  support.  Without  her  concern 
and  patience  this  project  could  not  have  been  completed. 


Table  of  Contents 


Acknowledgments  .....  . 

List  of  Figures  . 

List  of  Tables . . . 

Abstract  . 

I.  Introduction . . . 

Overview  . 

Statement  of  Problem  . 

Objectives  of  Research  . 

Research  Questions  . 

Scope  . 

Assumptions  . 

II.  Literature  Review  . 

Introduction  . 

Definition  of  Terms  . 

Measuring  Organizational  Effectiveness 
Framework  for  Resource  Availability 

III.  Methodology  . 

Overview . . . 

Limitations  of  Ratio  Analysis  .  .  .  . 
Limitations  of  Linear  Regression  .  .  . 

Data  Envelopment  Analysis  . 

Constrained  Facet  Analysis  . 

Specifying  Input  and  Output  Measures  . 
Identifying  Input  and  Output  Measures 

of  Available  Resources  . 

Outputs  Selected  . 

Supply  Inputs  Selected  . 

Vehicle  and  Equipment  Inputs  Selected 

Personnel  Inputs  Selected  . 

Data  Population  . 

Criteria  for  Evaluating  Research 
Questions  . 


IV.  Selection  of  Output  and  Input  Measures 
and  Data  Collection  . 


Introduction  . 

Outputs  Selected  . 

Inputs  Selected  . 

Data  Collection  . 

V.  Analysis  and  Results  . 

Introduction  . 

CFA  Program  Execution  ........ 

CFA  Code  Limitations  . 

Reduction  of  Output  and  Input  Measures 

Pearson  Correlation  Results  . 

Research  Question  1  . 

Research  Question  2  .  . 

Research  Question  3  . 

Research  Question  4  . 

VI.  Conclusions  and  Recommendations  . 

Introduction  . 

Specific  Conclusions  . 

Effects  of  CFA  Program  Limitations  .  . 
Recommendations  . 

Appendix  A:  Model  Used  in  Constrained  Facet 
Analysis  of  Not  Fully  Enveloped 
Units  . 

Appendix  B:  Bases  Used  in  Research  . 

Appendix  C:  Data  Collection  Request  ...... 

Appendix  D:  Data  File . .  .  .  .  . 

Appendix  E:  Summary  File  . 

Appendix  F:  Lamda  File  . 

Bibliography  . 


List  of  Tables 


Table 

1.1  Factors  of  the  Functional  Model  of 

Effectiveness  . 

2.1  Frequency  of  Occurrence  of  Evaluation 

Criteria  . 

4.1  Output  Measures  Selected  . 

4.2  Input  Measures  Selected  . 

5.1  Reduced  Output  Measures  . 

5.2  Reduced  Input  Measures  . 

5.3  Output  Change  Report  for  DMU  1  . 

5.4  Comparison  of  Variable  Significance  .  .  . 

5.5  Output  Change  Report  for  DMU  51  . 

5.6  Output  Change  Report  for  DMU  24  . 

5.7  Input  Change  Report  for  DMU  24  . 

5.8  Efficiency  Frontier  for  DMU  24  . 

5.9  Input  Change  Report  for  an  Efficient  Unit 

5.10  Comparison  of  Outputs  and  Inputs  Selected 


AFIT/GEM/LSM/84S-8 


Abstract 

The  purpose  of  this  research  effort  was  to  determine  if 
a  quantitative  model  of  the  efficient  use  of  available 
resources  could  be  developed  for  Base  Level  Civil 
Engineering  organizations.  Available  resources  included 
personnel,  material  supplies  and  vehicle  resources  and  was 
limited  to  those  resources  used  in  the  Operations  Branch. 

The  modeling  technique  used  in  this  research  effort  was  the 
Constrained  Facet  Analysis  (CFA)  which  can  evaluate  an 
organization  based  on  a  set  of  multiple  outputs  and  multiple 
inputs.  The  set  of  outputs  and  inputs  were  simultaneously 
evaluated  to  produce  one  effciency  rating  for  each 
organization  in  the  data  set.  The  model  also  identified  the 
relative  importance  of  each  output/ input  variable  and 
identified  the  surplus  variables  causing  the  inefficient 
rating  in  the  inefficient  organizations.  The  analysis  was 
accomplished  by  collecting  data  from  the  civil  engineering 
organization  within  the  Tactical  Air  Command.  The  data  was 
analyzed  using  the  CFA  program  at  the  University  of  Texas  at 
Austin.  The  results  illustrated  that  the  efficient  use  of 
available  resources  could  be  modeled  using  the  CFA 
technique . 


vii 


METHODOLOGY  FOR  MEASURING 
THE  EFFICIENT  USE  OF  AVAILABLE  RESOURCES 
IN  AIR  FORCE  CIVIL  ENGINEERING  ORGANIZATIONS 

I .  Introduction 

Overview 

Research  in  the  field  of  organizational  effectiveness 
has  rapidly  grown  in  recent  years.  Increased  economic 
constraints  force  organizations  to  look  for  more  effective 
and  efficient  means  of  producing  their  goods  and  services. 
Productivity  in  operations  will  be  the  number  one  goal 
stressed  by  managers  in  the  future  (Bryne,  1978). 

Even  though  organizational  effectiveness  is  a 
relatively  new  field  of  study  in  organizational  behavior, 
many  organizational  theorists  have  made  an  attempt  to 
develop  the  criteria  that  describes  effectiveness.  Because 
of  these  many  varied  approaches,  organizational 
effectiveness  has  become  a  nebulous  term  that  is  difficult 
to  define.  The  development  of  meaningful,  relevant  data 
describing  the  performance  of  an  organization  often  proves 
more  difficult  and  costly  than  managers  expect  (Bryne, 
1978).  Xerox  executive  Vincent  Bryne  (1978)  further  points 
out  that  too  often  managers  develop  measures  that  provide 
them  a  "static  snapshot"  of  the  organization  which,  over 
time,  may  provide  trend  data,  but  does  not  identify  cause- 
effect  relationships. 


Like  many  major  corporations,  military  organizations 
have  become  more  concerned  with  the  effective  utilization  of 
resources.  Pressure  from  the  public  sector  to  reduce 
federal  budget  deficits  places  an  increased  burden  upon 
government  officials.  The  Department  of  Defense  (DOD) 
maintains  the  largest  portion  of  controllable  federal 
expenditures,  therefore,  the  DOD  becomes  more  susceptible  to 
budget  reductions.  Former  Assistant  Secretary  of  Defense 
Frank  Carlucci  began  the  campaign  to  enhance  organizational 
effectiveness  by  implementing  several  productivity 
improvement  actions  (Howell  &  Van  Sickle,  1982).  DOD 
Directive  5010.31  and  DOD  5010.34  establish  the  foundation 
of  the  DOD  Productivity  Program.  These  guidelines  instruct 
DOD  managers  to  focus  their  attention  on  achieving  maximum 
outputs  within  available  resource  levels  and  operating  both 
efficiently  and  effectively  (Howell  &  Van  Sickle,  1982). 

As  stated  earlier,  measuring  organizational 
effectiveness  is  a  difficult  task,  but  this  task  is  more 
complex  in  a  military  organization  since  it  is  a  non-profit 
organization.  Anthony  and  Herzlinger  (1980)  identify  a  set 
of  nine  characteristics  of  a  non-profit  organization. 

1.  An  absence  of  a  profit  measure. 

2.  Tendency  to  be  service  organizations. 

3.  Constraint  on  goals  and  strategies  due  to  a  lack  of 
choice  on  where  to  do  business. 

4.  Less  dependent  on  clients  for  financial  support. 


5.  Dominance  of  professionals  in  top  management. 

6.  Line  of  responsibility  is  often  unclear. 

7  Chief  executive  officer  does  not  have  overall 
responsibility. 

8.  Importance  of  political  influences. 

9.  A  tradition  of  inadequate  management  controls. 

The  absence  of  a  profit  measure  is  a  key  factor  in 

establishing  criteria  of  effectiveness  in  military 
organizations.  In  a  profit-oriented  company,  success  is 
measured  by  the  amount  of  profits  an  organization  earns,  and 
managers  make  decisions  based  on  which  alternative  will 
produce  the  largest  profit  margin  (Anthony  4  Herzlinger, 
1980).  Likewise,  sales  and  credit  suffer  if  a  company  is 
inefficient  (Howell  &  Van  Sickle,  1982). 

Since  military  organizations  are  service-oriented, 
management  decisions  are  made  on  the  basis  of  providing  the 
best  possible  service  with  the  available  resources,  so  the 
success  of  the  organization  is  often  hard  to  determine 
(Anthony  &  Herzlinger,  1980).  Government  managers  do  not 
have  fast  and  specific  feedback  mechanisms  like  profit 
measures  which  detect  inefficient  operations  (Howell  4  Van 
Sickle ,  1 982 ) . 

The  Office  of  the  Secretary  of  Defense  (OSD)  has 
established  a  six  year  program  that  will  perform  efficiency 
reviews  of  all  military  support  activities  (RPMA,  1983). 

The  goal  of  this  program  is  to  increase  productivity  through 


the  accomplishment  of  each  Service's  mission  in  the  most 
cost-effective  manner,  without  decreasing  mission 
effectiveness.  The  OSD  has  already  projected  a  four  percent 
manpower  savings  as  a  result  of  this  review  program.  For 
Air  Force  manning  alone,  this  equates  to  800  slots  per  year 
for  the  next  five  years.  Those  support  activities  that  can 
demonstrate  the  most  efficient  use  of  their  resources  will 
face  the  least  manpower  reductions.  (RPMA,  1983) 

The  need  for  a  set  of  criteria  to  measure 
organizational  effectiveness  has  become  apparent  in 
objectives  established  by  Air  Force  Civil  Engineering 
directives.  Major  General  Clifton  D.  Wright  (1983), 

Director  of  Engineering  and  Services,  sets  forth  in  the 
Engineering  and  Services  Strategic  Plan  the  goal  "to  improve 
organizational  structure,  policies,  regulations,  and 
procedures  to  enable  the  Base  Civil  Engineer  and  Chief  of 
Services  to  do  their  jobs  more  effectively."  Air  Force 
Civil  Engineering  faces  real  threats  of  continuing  manpower 
reductions,  contracting  out  of  functions,  and  the 
possibility  of  a  tri-service  Real  Property  Maintenance 
Activity  (RPMA)  approach  (RPMA,  1983). 

The  mission  of  base  civil  engineering  maintenance 
management  is  to  "provide  the  necessary  assets  and  skilled 
personnel  to  prepare  and  sustain  global  installations  as 
stationary  platforms  for  the  projection  of  aerospace  power  in 
peace  and  war"  (AFR  85-10,  1975).  According  to  AFR  85-1, 


(1982),  Resources  and  Work  Force  Management,  the  goal  of 
civil  engineering  management  is 

to  provide  an  operational  installation  capable  of 
supporting  the  mission,  including  the  development  and 
implementation  of  programs  designed  to  improve  the 
livability  of  the  base  community.  Maintenance 
management  procedures  are  important,  because  they 
provide  the  framework  for  an  orderly  process  that 
matches  available  resources  with  requirements. 

Although  the  correct  use  of  procedures  can  lead  to 
successful  programs,  it  is  not  the  only  measure  of  an 
effective  BCE  organization.  Positive  results  in  terms 
of  mission  and  people  supporting  programs  are  the  best 
measure  of  success. 

The  text  of  this  regulation  allows  civil  engineers  to  be 
flexible  in  the  performance  of  their  duties.  Because  the 
mission  of  civil  engineering  is  service-oriented,  developing 
measurment  criteria  for  organizational  effectiveness  has 
become  a  challenging  task  for  the  civil  engineering 
community. 

Increased  civil  engineering  effectiveness  has  been  a 
key  issue  of  directors  of  civil  engineering  since  Major 
General  Guy  H.  Goddard  first  addressed  the  issue  in  the 
early  1970's  (Baumgartel  &  Johnson,  1979).  Civil 
engineering  spends  40-60%  of  a  base's  total  operations  and 
maintenance  budget  (McKnight  &  Parker,  1983).  Since  civil 
engineering  accounts  for  such  a  large  portion  of  the 
operations  and  maintenance  expenditures,  the  emphasis  on 
increased  productivity  creates  the  need  for  measurement 


criteria 


Statement  of  Problem 

In  response  to  an  Air  Staff  thesis  proposal ,  Capt. 
McKnight  and  Capt.  Parker  (1983)  began  the  development  of  a 
model  of  base  civil  engineering  organizational 
effectiveness.  They  defined  the  development  of  this  model 
as  a  three  stage  process.  Stage  one  defines  the  criteria  or 
areas  of  importance.  Stage  two  is  the  development  of 
measures  for  these  criteria,  and  stage  three  includes  the 
validation  and  application  of  the  model.  McKnight  and 
Parker  successfully  completed  the  first  stage  of  this 
process  by  determining  nine  factors  of  organizational 
effectiveness  of  a  base  civil  engineering  squadron.  (See 
Figure  1 ) . 

McKnight  and  Parker  describe  organizational 
effectiveness  (OE)  as  a  function  of  the  nine  factors  that 
were  determined  by  surveying  wing,  base  and  base  civil 
engineering  commanders  at  Continental  United  States  (CONUS) 
installations.  Their  function  does  not  determine  how  much 
each  factor  affects  organizational  effectiveness,  only  that 
a  relationship  exists  (McKnight  &  Parker,  1983). 

OE  =  f ( FI ,  F2 ,  F3 ,  F4 ,  F5,  F6,  F7,  F8,  F9)  where: 

FI  «  Fire  Protection 

F2  =  Leadership 

F3  *  Readiness 

F4  =  Resource  Availability 

F5  =  Organizational  Health 

F6  =  Program  Mangement 

F7  =  Contract  Management 

F8  =  Operations  Workforce  Performance 

F9  =  Customer  Image 


The  nine  factors  stated  in  their  model  were  defined  by  33 
criteria  specified  as  critical  components  to  organizational 
effectiveness  by  the  survey  respondents.  (See  Table  1.1). 


TABLE  1 . 1 

Factors  of  the  Functional  Model  of  Effectiveness 


i 

i 


Factor  1 : 


Fire  Protection 


1.  Fire  Protection  Capability 

2.  Fire  Crash/Rescue  Capability 


Factor  2:  Leadership 

1 .  Supervision  of  Operations  Workforce 

2.  Management  of  Engineers  and  Draftsmen 

3.  Leadership 


Factor  3:  Readiness 

1 .  Readiness  Capability 


Factor  4 :  Resource  Availability 

1 .  Number  of  Personnel  Assigned  vs  Authorized 

2.  Material  Availability 

3.  Sufficient  Number  of  Vehicles 


Factor  5 :  Organizational  Health 

1 .  Commitment  of  Personnel 

2.  Organizational  Morale 

3.  Cooperation  between  CE  Branches 

4.  Retention  of  Personnel 

5.  Communication  up  and  down  the  Chain  of  Command 

6.  Recognition 


TABLE  1 . 1  Continued 


Factor  6:  Program  Management 

1 .  Management  of  the  CE  Budget 

2.  Emphasis  on  Energy  Conservation 

3.  Quality  of  OJT  Programs 

4.  Personnel  and  Vehicle  Safety 


Factor  7:  Contract  Management 

1 .  Accuracy  of  Contract  Work  Descriptions 

2.  Identification  of  Maintenance  and  Repair 
Work  by  Contract 

3.  Accuracy  of  Engineering  Design  Program 


Factor  8:  Operations  Workforce  Performance 

1 .  Maintenance  of  Military  Family  Housing 

2.  Utility  System  Operations 

3.  Workforce, Productivity 

4.  Base  Appearance 

5.  Weekly  Schedule  Compliance 

6.  Integrity  of  RMP  Program 

7.  Airfield  Maintenance 


Factor  9;  Customer  Image 

1 .  Public  Relations  Effort  of  CE 

2.  Professional  Image  of  CE  Customer  Service  Unit 

3.  Customer  Satisfaction 

4.  Responsiveness 


The  purpose  of  this  research  effort  was  to  identify  the 


variables  that  constitute  resource  availability  (Factor  4) 
and  develop  a  model  that  measures  the  efficient  use  of 
available  resources  in  a  base  level  civil  engineering 
organization.  By  modeling  the  efficient  use  of  available 
resources,  this  research  effort  will  aid  in  determining  the 
efficiency  of  civil  engineering  organizations,  thus 
contributing  to  the  goal  of  the  OSD  productivity  improvement 
program.  The  use  of  available  resources  is  one  area  in 
which  civil  engineering  managers  can  improve  performance 
without  degrading  mission  effectiveness  simply  by  being  more 
efficient  in  the  application  of  their  available  resources. 
This  research  effort  established  a  standard  set  of 
measurement  criteria  and  validated  a  model  that  determines 
the  efficient  use  of  available  resources  based  on  a  set  of 
measurement  criteria. 

Objectives  of  Research 

The  objective  of  this  research  effort  was  to  continue 
the  study  initiated  by  McKnight  and  Parker  in  order  to 
develop  an  organizational  model  for  CONUS  base  level  civil 
engineering  units.  This  author  will  be  completing  one 
portion  of  the  required  research  effort,  but  combined  with 
the  efforts  of  other  researchers,  the  entire  model  may  be 
completed  and  used  as  a  mangement  tool  by  civil  engineering 
managers  to  evaluate  and  identify  inefficient  areas  within 
their  organization.  At  the  time  of  this  research,  research 


was  also  being  conducted  on  the  factors  of  leadership,  fire 
protection,  program  management  and  contract  management.  The 
approach  of  this  study  was  to  review  literature  concerning 
the  development  of  measurement  standards  of  organizational 
effectiveness  and  determine  an  appropriate  modeling 
technique  to  use  for  measuring  the  efficient  use  of 
available  resources. 

Research  Questions 

To  achieve  the  research  objective,  the  following 
research  questions  were  answered: 

1.  Which  variables  describe  a  unit's  available 
resources? 

2.  How  will  the  variables  be  weighted? 

3.  Which  variables  significantly  impact  the  efficient 
use  of  available  resources? 

4.  Can  tradeoffs  and  recommendations  be  found  which 
allow  inefficient  organizations  to  improve  their 
efficiency? 

Scope 

This  research  effort  was  limited  to  determining 
measurement  criteria  for  CONUS  Air  Force  installations.  The 
study  conducted  by  McKnight  and  Parker  (1983)  was  limited  to 
surveying  CONUS  installations,  hence,  research  into  the 
development  of  measurement  criteria  must  also  be  limited  to 


CONUS  installations. 


As  stated  earlier,  the  purpose  of  this  research  effort 
is  to  determine  the  criteria  that  constitute  resource 
availability  as  a  factor  of  organizational  effectiveness. 

In  order  to  narrow  the  scope  of  this  project,  the  available 
resources  to  be  analyzed  was  limited  to  those  resources  used 
in  the  Operations  Branch  of  the  Civil  Engineering  units. 

The  Operations  Branch  is  responsible  for  all  the  day-to-day 
maintenance  and  repair  tasks  of  a  civil  engineering  unit. 
Some  minor  construction  projects  are  also  accomplished. 
Approximately  80%  of  the  civil  engineering  work  force  is  in 
the  Operations  Branch.  This  research  effort,  therefore, 
focused  on  those  resources  controlled  by  civil  engineering 
managers  in  their  daily  work  function. 

The  model  developed  determined  how  efficient  a  civil 
engineering  organization  uses  available  resources.  By 
improving  efficiency,  an  organization  can  improve  its 
productivity  and  effectiveness.  The  information  gained  by 
using  an  efficiency  model  will  allows  managers  to  reevaluate 
resource  allocation  in  a  logical  manner  and  make  appropriate 
adjustments  without  degrading  organizational  effectiveness. 

Assumptions 

This  research  effort  was  based  on  the  following 
assumptions: 

1 .  Resource  availability  is  actually  a  factor  of 


organizational  effectiveness. 


2.  The  mission  of  overseas  installations  differs  from 
CONUS  installations  due  to  increased  readiness  requirements 

3.  Base  level  civil  engineering  managers  will  be  able 
to  collect  data  that  describes  input  and  output  criteria  of 
available  resources. 

4.  By  increasing  the  efficient  use  of  available 
resources,  managers  will  be  able  to  improve  the 
productivity,  and  thus,  the  effectiveness  of  their 


II.  Literature  Review 

Introduction 

This  chapter  reviews  the  current  approaches  to 
decscribing  organizational  effectiveness.  Many  theories 
have  been  developed  to  describe  organizational 
effectiveness,  but  organizational  theorists  seem  to  agree  on 
only  one  thing:  that  organizational  effectiveness  is 
multidimensional  and  the  determinants  of  organizational 
effectiveness  vary  among  organizations  (Angle  &  Perry, 

1981).  This  review  compare^  existing  theories  on 
measurement  criteria  in  order  to  establish  a  framework  for 
determining  the  criteria  of  resource  availability  as  a 
factor  of  organizational  effectiveness.  Frank  Harrison 
(1978)  describes  current  theories  on  organizational 
effectiveness  by  stating  that 

There  is  no  lack  of  criteria  for  assessing  the 
performance  of  formal  organizations;  there  is,  however,  a 
lack  of  general  agreement  as  to  which  criteria  are  most 
valid  and  meaningful  for  use  within  a  given  organization. 

Noted  organizational  theorist  Richard  M.  Steers  (1975) 
conducted  a  study  on  17  models  of  organizational 
effectiveness  and  found  that  the  different  models  used  a 
diverse  set  of  criteria  to  evaluate  organizational 
effectiveness.  (See  Table  2.1).  Steers  thought  that  too 
many  approaches  take  a  macro  approach  to  organizational 


effectiveness,  thus  making  measurement  criteria  difficult  to 
determine  and  far  too  often  useless  as  a  management  tool 
(Steers,  1975). 


TABLE  2.1 

Frequency  of  Occurrence  of  Evaluation  Criteria 


Criteria 


Number  of  times  mentioned 


Resource  management  affects  many  of  the  criteria 
identified  in  the  study  conducted  by  Steers.  Not  only  does 
it  affect  resource  acquisition,  it  also  plays  a  key  role  in 
the  productivity,  profitability,  and  efficiency  of  an 
organization.  The  management  of  available  resources  can  be 
considered  one  of  the  most  important  factors  of 
organizational  effectiveness. 


Budget  reductions  and  constrained  national  resources 
make  the  need  for  the  development  of  measurement  criteria 
for  organizational  effectiveness  even  more  evident  in  the 
federal  government.  In  the  study  completed  by  McKnight  and 
Parker  (1983),  resource  availability  was  identified  as  the 
fourth  most  important  factor  in  organizational  effectiveness 
in  civil  engineering  units.  Although  mission  requirements 
are  increasing,  the  supporting  elements  of  money,  material, 
and  manpower  are  becoming  more  scarce  (Thorne,  1980). 

This  chapter  will  review  organizational  theories  to 
determine  if  resource  availability  can  affect  and  help 
describe  organizational  effectiveness.  It  will  also  review 
current  studies  conducted  on  approaches  to  productivity  and 
effectiveness  of  Air  Force  organizations  and  Air  Force  civil 
engineering  units.  Before  discussing  the  current 
literature,  several  key  terms  need  to  be  defined. 

Definition  of  Terms 

A  distinction  between  efficiency,  productivity,  and 
effectiveness  is  necessary  in  any  discussion  of 
organizational  effectiveness.  The  interrelationship  between 
these  terms  varies  among  organizational  theorists.  As 
demonstrated  in  Steers'  (1975)  criteria  study,  productivity 
and  efficiency  have  been  identified  in  many  approaches  as 
key  evaluation  criteria  for  organizational  effectiveness. 

Most  theorists  agree  on  the  definition  of  efficiency  as 
the  ratio  of  inputs  to  outputs  (Angle  &  Perry,  1981;  Anthony 


&  Herzlinger,  1980;  Harrison,  1978;  and  Thorne,  1980). 

Using  efficiency  as  an  evaluation  criteria  is  common  in  most 
taxonomies  of  the  dimensions  of  organizational  effectiveness 
(Angle  &  Perry,  1981;  Steers,  1975).  Efficiency  has  also 
been  defined  as  the  quantity  factor  of  productivity  (Thorne, 
1980).  Harrison  (1978)  identifies  efficiency  as  a  short- 
range  factor  that  contributes  to  the  short  and  long-range 
aspects  of  effectiveness.  He  makes  a  distinction  between 
efficiency,  doing  things  right,  and  effectiveness,  doing  the 
right  things.  For  the  purpose  of  this  discussion, 
efficiency  is  defined  as  the  amount  of  output  per  unit  of 
input  without  regard  to  organizational  goals  and  objectives. 

The  definition  of  productivity  is  not  as  clear  as  the 
definition  of  efficiency.  Productivity  has  been  defined 
along  the  lines  of  efficiency  as  the  measure  of  output  to 
some  measure  of  input  (Baumgartel  &  Johnson,  1979),  others 
have  defined  productivity  as  the  process  where  efficiency 
and  effectiveness  constitute  productivity  (Thorne,  1980). 
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Figure  2.  Components  of  Productivity  (Thorne,  1980) 


In  the  Department  of  Defense,  measuring  productivity  is 
difficult  because  of  the  lack  of  performance  measures.  In 
the  private  sector,  management  decisions  rely  on  business 
orientation  toward  revenues,  returns  on  investment,  and 
profit  to  measure  efficiency  and  effectiveness  (Thorne, 

1980;  Anthony  &  Herzlinger,  1980).  Productivity  is  not 
easily  measured  in  the  public  sector  because  1 )  outputs  are 
not  always  measurable  in  quantitative  terms,  and  2)  multiple 
objectives  preclude  the  use  of  a  single  measure  (Thorne, 
1980).  As  stated  earlier,  DOD  organizations  are  service- 
oriented;  hence,  increased  productivity  relies  upon  cost 
reductions  and  maintaining  the  same  level  of  service. 

Although  theorists  differ  in  their  definitin  of 
productivity,  an  interrelationship  between  efficiency, 
productivity,  and  effectiveness  does  exist.  Productivity  is 
defined  as  the  measure  of  input  required  to  produce  a 
desired  measure  of  output.  The  key  difference  between 
efficiency  and  productivity  is  that  productivity  takes  into 
account  a  desired  level  of  output  where  efficiency  is 
merely  the  ratio  of  output  to  input.  Productivity  is 
therefore,  the  link  between  efficiency  and  effectiveness. 

Effectiveness  is  defined  as  the  relationship  between  a 
unit's  outputs  and  objectives  (Anthony  &  Herzlinger,  1980). 
In  other  words,  effectiveness  is  how  well  an  organizational 
unit  performs  its  job  in  respect  to  desired  goals  and 
objectives.  Effectiveness  can  also  be  defined  as  the 
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capacity  to  pursue  and  reach  operational  objectives  (Hitt  4 
Middlemist,  1979).  But  like  productivity,  measuring 
effectivness  is  often  a  more  difficult  task  because  an 
organization's  objectives  may  be  quite  general  and/or 
nebulas  in  nature  (Thorne,  1980).  Effectiveness,  therefore, 
is  defined  as  the  amount  of  output  required  to  achieve 
organizational  objectives.  Increasing  efficiency  alone  may 
not  necessarily  increase  effectiveness,  but  by  increasing 
efficiency  to  increase  productivity  will  lead  to  increased 
effectiveness . 

Measuring  Organizational  Effectiveness 

Many  attempts  have  been  made  to  correctly  identify  the 
measurment  criteria  of  organizational  effectiveness.  Steers 
(1975)  developed  a  set  of  eight  problem  areas  that  must  be 
addressed  in  the  development  of  any  measurement  criteria. 

1.  Construct  Validity  -  a)  identify  the  domain  of  the 
relevant  criteria  and,  b)  determine  the  interrelationship 
between  variables  and  how  the  exterman  environment  affects 
them. 

2.  Criterion  Stability  -  criteria  changes  over  time. 

3.  Time  Perspective  -  what  time  frame  is  used  to 
measure  effectiveness? 

4.  Multiple  Criteria  -  what  is  the  relationship 
between  criteria? 

5.  Precision  of  Measurement  -  does  the  model 
accurately  and  consistently  quantify  the  criteria? 


6.  Generalizability  -  does  the  criteria  apply  to  other 
organizations? 

7.  Theoretical  Relevance  -  does  the  model  contribute 
to  our  understanding? 

8.  Level  of  Analysis  -  at  what  level  of  the 
organization  does  the  model  evaluate  effectiveness? 

These  problems  exist  in  any  measure  of  organizational 
effectiveness.  The  problem  areas  identified  above 
demonstrate  the  complexity  of  measuring  organizational 
effectiveness.  Taking  into  account  the  external  factors  of 
an  organization  alone  could  be  an  endless  task. 

Early  models  of  organizational  effectiveness  were  one¬ 
dimensional  in  nature.  These  models  are  divided  into  three 
categories.  The  first  category  evaluated  the  performance  of 
the  organizational  structure  and  included  the  Rational-Goal 
and  Systems  Resource  approach.  Category  two  deals  with  the 
performance  of  the  organization's  human  resources.  The 
Managerial  Process  and  Organizational  Development  theories 
are  the  two  major  models  of  the  human  resources  approach. 

The  final  category,  which  includes  the  Bargaining, 

Structural  Functional,  and  Functional  approaches,  evaluates 
the  impact  of  an  organization's  functions  or  activities  on 
organizational  effectiveness.  (Cunningham,  1977) 

Of  the  three  categories,  the  management  of  available 
resources  approach  to  organizational  effectiveness  falls  in 
category  three  under  the  Bargaining  approach.  In  this 


approach,  a  decision-maker  should  allocate  his  resources  to 
respond  to  the  problems  of  the  highest  demand  (Cunningham, 
1977).  An  organization  is  considered  effective  if  the 
maximum  return  is  obtained  from  the  distribution  of 
resources.  Managers  should  make  resources  available  on  the 
basis  of  the  best  possible  payoff  from  the  use  of  resources 
(Cunningham,  1977). 

Effectiveness  statements  are  typically  evaluative  and 
normative  in  nature  and  rarely  describe  the  performance  of 
an  organization  (Conlon  &  Connolly,  1980).  Effectiveness 
criteria  are  measured  against  a  set  of  standards /norms 
established  by  management  to  evaluate  performance.  Conlon 
and  Connolly  (1980)  agree  with  Steers  in  respect  to  the 
nature  of  organizational  effectiveness.  They  proposed  a 
multiple  evaluation  approach  which  combined  the 
"organizational  goals"  theorists'  and  "systems"  theorists' 
views  in  order  to  view  organizational  constituencies  instead 
of  relying  upon  one  single  statement  (Conlon  &  Connolly, 
1980) . 

The  resource  management  approach  is  prevelant  in  the 
systems  resource  approach  developed  by  Yuchtman  and 
Seashore.  In  their  approach,  an  organization  is  considered 
effective  if  it  has  the  ability  "to  exploit  its  environment 
in  the  acquisition  of  scarce  and  valued  resources"  (Conlon  & 
Connolly,  1980).  Making  resources  available  for  production 
purposes  is  the  key  to  survival  for  an  organization.  The 


most  important  management  decisions  deal  with  the 
acquisition  of  resources. 

The  acquisiton  of  needed  resources  is  also  identified 
in  the  four  approach  hierarchy  defined  by  Kim  Cameron 
(1980).  His  study  developed  four  approaches  to  the 
evaluation  of  organizations: 

1.  How  well  an  organization  accomplishes  its  goals. 

2.  How  well  an  organization  acquires  needed  resources. 

3.  Are  there  smooth  internal  processes  and  operations 
in  the  organization? 

4.  How  well  an  organization  responds  to  the  demands 
and  expectations  of  any  group  or  individual  who  has  a  stake 
in  the  organization. 

Again,  resource  availability  is  defined  as  a  critical  aspect 
of  organizational  effectiveness.  But  according  to  Cameron 
(1980),  organizations  with  separate  levels  of  command,  like 
military  organizations  (non-profit  organizations),  cannot 
use  any  of  these  approaches  because  of  the  characteristics 
of  such  organizations.  He  discusses  several  reasons  why 
these  approaches  do  not  work  for  military  organizations, 
including  the  lack  of  measurable  outcomes,  goals  that  are 
ill-defined  and  complex,  and  a  widely  differing  criteria  of 
success  (Cameron,  1980). 

Other  recent  studies  suggest  that  a  multivariate  model 
of  effectiveness  is  the  most  useful  and  relevant  (Hitt  & 
Middlemist,  1979).  By  combining  the  theories  of  Yuchtman, 


Seashore,  and  Steers,  guidelines  for  criteria  development  in 
an  effectiveness  measurement  methodology  can  be  determined. 
These  guidelines,  developed  by  Hit  and  Middlemist  (1979), 
are  as  follows: 

1 .  Criteria  should  be  based  on  organizational  goals 
and  objectives. 

2.  Criteria  should  allow  for  comparative  study  of 
organizations  that  perform  different  functions  or  operate  in 
different  environments. 

3.  Other  relevant  criteria  besides  productivity 
criteria  should  be  included. 

4.  Methodology  should  include  both  positive  and 
negative  effectiveness  criteria. 

5.  A  procedure  for  determining  proper  weightings  of 
different  criteria  should  be  included. 

6.  The  method  for  determining  criteria  should  be 
applicable  at  different  analytical  levels. 

7.  The  method  and  resulting  criteria  should  allow  for 
the  uniqueness  of  the  organization  and/or  unit. 

The  four  approaches  of  Cameron  are  included  in  the 
underlying  principles  of  these  guidelines. 

Organizational  effectiveness  has  become  a  key  issue  to 
military  leaders  in  recent  years  due  to  scarce  resources  and 
force  reductions.  The  paradox  of  doing  more  with  less  has 
become  a  reality.  The  development  of  resurce  management 
practices  to  increase  productivity  is  prevelant  in  the  DOD. 


The  purpose  of  the  resource  management  function  is  to 
"assure  that  limited  resources  are  utilized  to  their  optimum 
level  in  support  of  specified  missions"  (Ciaccio,  1983). 
Resources  also  play  a  critical  role  in  the  determination  of 
force  readiness.  DOD  decision  makers  and  readiness  managers 
have  few  analytical  tools  available  that  relate  readiness  to 
resource-flow  decisions  (Paulson  &  Shishko,  1981).  Resource 
availability,  therefore,  must  be  considered  in  any  measure 
of  organizational  effectiveness. 

As  stated  in  Chapter  I,  the  Department  of  Defense 
established  a  productivity  program  with  the  issuance  of  DOD 
Directive  5010.31  and  DOD  Instruction  5010.34.  The  Air 
Force  Human  Resources  Laboratory  ( AFHRL )  was  assigned  the 
duty  of  developing  the  Air  Force  productivity  measurement 
system.  Productivity  was  defined  as  the  ratio  of  output  to 
input  with  goals  considered  (Howell  &  Van  Sickle,  1982). 
Working  in  conjunction  with  the  Maryland  Center  for 
Productivity  and  Quality  of  Work  Life,  the  following 
objectives  were  established:  (Howell  &  Van  Sickle,  1982) 

1 .  To  review  and  define  productivity  criteria. 

2.  To  evaluate  and  classify  efficiency  and 
effectiveness  measures. 

3.  To  identify  major  classes  of  variables  which  impact 
productivity. 

4.  To  develop  a  conceptual  framework  for  productivity 


research. 


5.  To  conduct  a  field  test  of  the  method  for 
generating  organization  productivity  criteria. 

The  Maryland  Center  Methodology  produced  productivity 
indicators  that  have  been  tested  in  weather,  administration, 
and  maintenance  areas.  Four  key  requirements  for 
productivity  measurement  methods  were  developed  from  this 
research  (Howell  &  Van  Sickle,  1982).  The  requirements  are: 

1 .  Organizational  goals  must  be  identified. 

2.  Output  must  be  quantifiable. 

3.  Input  must  be  quantifiable. 

4.  The  time  period  to  be  measured  must  be  specified. 

Working  independently  from  AFHRL  and  the  Maryland 

Center,  Baumgartel  and  Johnson  (1979)  developed  a 
productivity  measurement  model  for  Base  level  USAF  civil 
enginering  organizations  using  a  network  of  performance 
indicators/ input  ratios.  Like  the  Maryland  Center  study, 
their  approach  to  productivity  was  based  on  four  questions: 

1 .  What  output  is  to  be  measured? 

2.  What  input  is  to  be  measured? 

3.  Which  input-output  comparisons  are  relevant  to  the 
organization? 

4.  How  are  comparison  results  interpreted? 

According  to  Baumgartel  and  Johnson,  and  congruent  with  the 
definition  stated  earlier,  productivity  is  determined  by  the 
ratio  of  outputs  to  inputs  with  organizational  goals 
considered.  The  performance  indicators  in  their  model  are 
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based  upon  the  overall  organizational  objectives  defined 
externally,  by  customer  requirements  and  MAJCOM  desired 
results,  and  internally  through  BCE  desired  results. 
Increasing  productivity  leads  to  increased  organizational 
effectiveness.  An  essential  element  to  productivity  is  the 
management  of  available  resources  as  demonstrated  by  their 
model. 

Framework  for  Resource  Availability 

Based  on  the  studies  of  organizational  effectiveness, 
it  appears  that  the  availabiltiy  of  resources  is  indeed  a 
factor  of  organizational  effectiveness.  Several  theorists 
used  the  resource  approach  as  a  single  factor  of 
effectiveness  (Yuchtman  &  Seashore,  Cameron  and  Cunningham) 
while  others  identified  resource  acquisition  and  management 
as  one  variable  of  a  multivariant  model  (Steers,  Baumgartel 
&  Johnson,  Conlon  &  Connolly,  Hitt  &  Middlemist).  In  order 
to  define  resource  availability  as  a  factor  of 
organizational  effectiveness,  the  following  guidelines  were 
used  in  the  measurement  criteria  development: 

1 .  Determine  and  quantify  the  input  and  output 
criteria  to  be  measured. 

2.  Base  the  criteria  on  defined  organizations  goals 
and  objectives. 

3.  Criteria  will  allow  comparison  between  civil 


engineering  organizations. 


4.  Input-Output  comparisons  will  be  weighted  according 
to  their  relevance  to  the  organization. 

5.  The  time  period  to  be  measured  will  be  specified. 

The  nine-factor  model  of  organizational  effectiveness 

developed  by  McKnight  and  Parker  (1983)  established  a  firm 
foundation  for  further  research.  The  model  they  developed 
follows  many  of  the  principles  stated  above.  By  combining 
their  initial  efforts  with  appropriate  modeling  techniques, 
a  useful  management  tool  was  developed  to  improve 
organizational  effectiveness  based  on  the  efficient  use  of 
available  resources.  The  modeling  techniques  and 
methodology  are  discussed  in  a  separate  literature 
review  in  Chapter  III. 


Ill .  Methodology 

Overview 

Measuring  the  efficient  use  of  available  resources  in 
Air  Force  civil  engineering  organizations  is  a  complex 
problem  because  of  its  multiple-input,  mutiple  output 
characteristic.  Few  analytical  models  can  correctly 
identify  inefficiencies  within  organizations  because  the 
models  cannot  compare  multiple-inputs  to  multiple-outputs, 
therefore,  losing  information  contained  in  the  interaction 
of  these  variables.  A  new  approach,  the  Constrained  Facet 
Analysis  (CFA)  which  takes  into  account  the  relationship  of 
multiple  inputs  and  outputs,  has  been  developed  by  Bessent, 
Bessent,  Clark  and  Elam  (1983).  Their  model  is  an  extension 
of  the  linear  programming  model  called  Data  Envelopment 
Analysis  (DEA)  developed  by  Charnes,  Cooper  and  Rhodes 
( 1  978) . 

The  Constrained  Facet  Analysis  model  will  be  used  in 
this  research  effort  to  measure  the  efficient  use  of 
available  resources  in  civil  engineering  organizations. 

This  chapter  will  first  discuss  the  limitations  of  ratio 
analysis  and  linear  regression  techniques  of  measuring 
efficiency.  Then,  a  brief  description  of  the  DEA  model  will 
be  given  along  with  the  development  of  the  CFA  model. 

Following  the  discussion  of  the  CFA  model  will  be  the 


specification  and  identification  of  input  and  output 


measures  of  available  resources  for  civil  engineering  units. 
Finally,  a  data  collection  plan  will  be  specified  as  well  as 
criteria  for  evaluating  the  research  questions  to  be 
answered  by  this  research  effort. 

In  order  to  achieve  the  research  objective  of  defining 
one  of  the  factors  of  the  organizational  model  for  CONUS 
base  level  civil  engineering  units,  the  following  research 
questions  must  be  answered: 

1.  Which  variables  describe  a  unit's  available 
resources? 

2.  How  will  the  variables  be  weighted? 

3.  Which  variables  significantly  impact  the  efficient 
use  of  a  unit's  available  resources? 

4.  Can  tradeoffs  and  recommendations  be  found  which 
allow  inefficient  organizations  to  improve  their  efficiency? 


Limitations  of  Ratio  Analysis 

Ratio  analysis  is  a  popular  method  of  comparing  the 
performance  of  similar  organizations.  Ratio  analysis  is  a 
simple  ex  post  facto  method  of  evaluating  organizations  by 
using  many  ratios  to  represent  multiple  input  and  output 
relationships.  The  most  common  ratio  analysis  typically 
uses  several  ratios,  each  of  which  is  a  single  output 
measure  divided  by  a  single  input  measure.  The  ratios  are 
then  compared  between  similar  organizations  to  determine 
which  organization  is  more  efficient,  i.e.,  the  one  with  the 
highest  ratio  of  output  to  input.  Ratio  analysis  does  not 


attempt  to  put  together  all  the  ratios  into  one  aggregate 
measure  of  efficiency,  therefore,  the  interaction  between 
all  the  inputs  and  outputs  is  not  taken  into  account.  As  a 
result,  ratio  analysis  cannot  accurately  compare  the 
performance  of  similar  organizations  that  have  multiple 
input  and  output  measures,  particularly  when  an  organization 
ranks  high  on  some  measures  and  low  on  others.  (Bessent, 
Bessent,  Clark,  1982) 

Ratios  tend  to  be  popular  measures  of  performance 
because  they  are  usually  familiar  to  managers  and  can  be 
easily  calculated.  The  information  obtained  from  these 
ratios  is  often  misleading  because  each  ratio  provides  only 
a  partial  measure  of  the  multiple  input-output  relationship. 

Ratios  typically  take  one  of  the  following  forms 
(Bessent,  Bessent,  Clark,  1982): 

1.  Percentages  (Assigned/Authorized) 

2.  Output/Input 

3.  Input /Output 

4.  Input/Input 

5.  Output/Output 

In  their  working  paper  comparing  DEA  to  statistical- 
econometrics  and  ratio  analysis,  Bessent,  Bessent,  and  Clark 
give  a  good  discussion  and  examples  of  the  problems 
encountered  with  the  use  of  ratios  in  the  DEA  model.  The 
risks  from  using  these  ratios  is  basically  the  same; 
"percentages  and  ratios  frequently  fail  to  explicitly 


represent  the  magnitudes  of  the  outputs  or  inputs  in  the 
numerators  and  denominators  of  the  ratios  during  DEA 
evaluation."  They  suggest  that  ratios  should  be  broken  down 
into  their  physical  input/output  components  for  the  DEA/CFA 
evaluation  and  then  after  the  analysis  the  ratios  could  be 
put  back  into  ratio  form  for  review  by  managers. 

Limitations  of  Linear  Regression 

Another  well-known  method  of  evaluating  the  performance 
of  an  organization  is  linear  regression.  Regression 
equations  develop  a  relationship  of  the  single-output, 
multiple-input  variety.  Regression  analysis  produces  a 
defined  curve  of  the  average  relationship  between  the  output 
and  multiple  inputs..  Again,  Bessent,  Bessent,  and  Clark 
(1982)  present  a  well-defined  and  illustrated  discussion 
comparing  regression  to  the  DEA  model.  They  point  out  three 
shortcomings  when  comparing  DEA  and  regression  results; 

1 .  Regression  estimates  fail  to  identify  the  existence 
and  degree  of  inefficiency  in  organizations. 

2.  Multiple  outputs  may  contain  interactions  which  are 
undetected  by  regressions  performed  on  each  output 
separately. 

3.  Regression  estimates  confound  inefficient  and 
efficient  units.  Better  regression  estimates  are  obtained 
using  the  efficient  units  only. 

Since  linear  regression  is  based  on  the  average 


relationship  of  all  the  observations,  residuals  (error 


terms)  can  take  on  positive  values  if  above  the  average  and 
negative  values  if  below  the  average.  The  efficiency 
frontier  is  determined  by  the  average,  therefore,  the  size 
and  direction  of  the  residuals  are  a  misleading  measure  of 
the  efficiency  of  the  organization.  The  average  is  not  the 
true  efficiency  frontier  for  a  given  set  of  observations. 

The  purpose  of  a  regression  equation  is  to  predict  the 
level  of  output  given  a  set  of  inputs.  Least  squares 
regression  can  only  take  into  account  the  relationship  of 
the  multiple-inputs  on  each  output  separately  in  the  case  of 
multiple-output  organizations.  Because  only  one  output  can 
be  analyzed  at  a  time,  the  interaction  between  outputs 
competing  for  the  same  resources  (inputs)  is  neglected. 

Another  shortcoming  of  regression  analysis  occurs  in 
the  case  of  organizations  operating  at  different  levels  of 
technology.  Both  organizations  could  receive  the  same 
amount  of  inputs  but  the  organization  with  a  higher  level  of 
technical  efficiency  would  achieve  a  higher  level  of  output. 
The  difference  in  their  expected  output  levels  would  be 
accounted  for  in  the  residual  term  as  a  random  error  when  in 
reality  the  variance  introduced  is  not  random,  but  actually 
caused  by  the  technological  difference.  The  regression 
curve  would  thus  lie  between  the  two  units  and  therefore 
would  misrepresent  both  organizations. 

Bessent,  Bessent,  and  Clark  found  that  by  removing  the 
inefficient  organizations  from  the  regression  equation,  the 
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R  values  increased  and  there  was  also  an  increase  in  the 
significance  levels  of  the  regression  coefficients.  One 
would  expect  a  decrese  in  the  R  value  and  significance 
levels  when  the  number  of  observations  are  decreased  which 
decreases  the  residual  degrees  of  freedom.  In  otherwords, 
more  of  the  variability  of  the  expected  levels  of  output  are 
being  explained  by  fewer  observation  points. 

Regression  analysis  techniques  are  inappropriate  for 
establishing  a  frontier  of  efficiency  for  nonprofit 
organizations.  The  shortcomings  of  regression  analysis  have 
only  been  briefly  discussed  here.  As  stated,  a  more  in- 
depth  discussion  along  with  examples  can  be  found  in  the 
paper  written  by  Bessent,  Bessent,  and  Clark  (1982). 


Data  Envelopment  Analysis 


The  key  shortcoming  of  both  ratio  analysis  and  least 
squares  regression  is  that  neither  approach  can 
simultaneously  evaluate  multile  inputs  and  outputs  when 
determining  efficiency  measures  for  an  organization.  The 
Data  Envelopment  Analysis  (DEA)  approach  was  developed  by 
Charnes,  Cooper  and  Rhodes  (1978)  to  determine  the 
efficiency  of  a  decision  making  unit  (DMU)  relative  to 
similar  units.  Their  technique  is  able  to  evaluate  the 
efficiency  of  a  DMU,  taking  multiple-inputs  and  multiple- 
outpus  into  account  simulataneously.  The  DEA  model 
generates  an  efficiency  rating  for  each  organization  using 
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external  methods  to  identify  the  units  that  produce  the 
highest  level  of  outputs  from  the  least  amount  of  inputs. 

Another  significant  characteristic  of  the  DEA  model  is 
that  it  is  able  to  compare  the  multiple-input,  multiple- 
output  measures  without  having  them  in  a  common  scale  or  unit 
of  measure.  DEA  is  able  to  do  this  because  it  is  comparing 
each  unit  to  the  same  measures  of  other  units  that  have 
similar  levels  of  outputs  and  inputs  and  therefore,  does  not 
require  commensurating  input  and  output  measures.  This 
characteristic  is  extremely  valuable  in  the  case  of  non¬ 
profit  organizations  that  cannot  always  measure  their 
objectives  monetarily. 

The  DEA  model  provides  a  single  aggregate  measure  of 
DMU's  efficiency.  An  efficiency  measure  is  a  ratio, 
therefore,  the  highest  possible  rating  a  unit  could  achieve 
would  be  1.0  since  it  is  being  compared  to  the  units  with 
the  greatest  amount  of  output  for  the  amount  of  inputs. 

All  units  are  compared  to  locate  the  best  ones  and  to  use 
those  units  as  the  criterion  for  efficiency  evaluations  of 
the  remaining  units  (Bessent,  Bessent,  1980).  A  unit  with  an 
efficiency  rating  of  1.0  will  have  the  best  combination  of 
outputs  and  inputs,  and  efficiency  less  than  1.0  would 
indicate  a  DMU  is  inefficient  relative  to  the  criterion 
units.  The  DEA  model  will  assign  the  highest  possible 
efficiency  when  rating  an  organization. 


The  DEA  technique  does  not  require  that  the  input  and 
output  measures  be  weighted  a  priori .  The  DEA  model  will 
assign  weights,  called  multipliers,  to  the  input  and  output 
measures,  and  these  multipliers  are  derived  empirically  from 
the  data  used  to  generate  the  efficiency  rating.  These 
multipliers  assigned  to  the  inputs  and  outputs  can  then  be 
used  to  locate  sources  of  inefficiency  within  a  DMO  and 
tradeoffs  that  can  be  made  to  increase  the  efficiency  rating 
of  the  DMU  (Bessent,  Bessent,  Kennington,  and  Reagan,  1982). 
The  multipliers  indicate  the  possible  shortages  in  output 
levels  and/or  averages  of  input  levels. 

Constrained  Facet  Analysis 

The  Data  Envelopment  Analysis  model  brought  about  a 
significant  improvement  in  the  evaluation  of  the  performance 
of  organizations,  but  DEA  had  several  limitations.  Though 
DEA  was  effective  in  classifying  DMU's  as  either  efficient 
or  inefficient,  relative  to  a  neighborhood  of  units  with  the 
greatest  amount  of  outputs  for  inputs,  DEA  is  limited  in  its 
ability  to  provide  planning  information  (Bessent,  Bessent, 
Clark,  and  Elam,  1983).  As  a  result,  a  new  approach  for 
computing  efficiency,  called  Constrained  Facet  Analysis 
(CFA)  was  developed  by  Bessent,  Bessent,  Clark,  and  Elam  at 
the  University  of  Texas  at  Austin. 

The  CFA  model  is  an  extensin  of  the  DEA  model.  Like 


DEA,  Constrained  Facet  Analysis  is  a  linear  programming 


model  that  determines  the  relative  efficiency  of  a  DMU 
compared  to  other  operating  units  with  similar  levels  of 
inputs  and  outputs.  The  CFA  model  first  identifies  the 
efficiency  frontier  made  up  of  those  units  with  the  highest 
level  of  outputs  for  their  given  level  of  inputs  and  assigns 
an  efficiency  rating  to  those  units  which  are  inefficient 
relative  to  the  frontier  units.  The  frontier  units  receive 
an  efficiency  rating  of  1.0.  Those  units  which  are 
inefficient  are  then  compared  to  only  those  units  on  the 
efficiency  frontier  with  similar  mixes  of  inputs  and 
outputs.  That  portion  of  the  frontier  identified  for 
comparison  is  called  the  "facet".  A  simple  case  can  be 
illustrated  using  two  input  measures,  and  one  output  measure 
for  eight  organizations  being  compared.  The  proper  facet 
for  Unit  A  is  identified  in  Figure  3.  (Bessent,  Bessent, 
Clark,  and  Elam,  1983) 

The  CFA  model  goes  through  an  iterative  process  where 
it  identifies  the  proper  facet  for  a  unit,  assigning  values 
for  the  unit's  efficiency  rating  and  multipliers  after  each 
iteration.  The  final  iteration  establishes  a  lower  bound 
efficiency  for  the  inefficient  unit  using  only  those  units 
in  a  nearby  frontier  facet,  units  which  have  similar  mixes 
of  inputs  and  outputs.  It  must  be  noted  here  that  the 
values  for  the  efficiency  rating  and  multipliers  for  a  given 
unit  after  the  first  iteration  of  CFA  will  equal  the  values 
that  DEA  would  assign  the  same  unit. 
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Figure  3.  Facet  Identification 


Constrained  Facet  Analysis  goes  through  this  iterative 
process  to  find  a  set  of  comparison  units  that  have  similar 
mixes  of  inputs  and  outputs  so  that  meaningful  information 


can  be  gained  for  the  inefficient  unit.  After  the  final 
iteration,  managers  of  the  inefficient  unit  will  be  able  to 
compare  possible  tradeoffs  to  units  that  are  similar  to 
their  own.  By  comparing  an  inefficient  unit  to  only  those 
units  similar  to  that  unit,  the  value  of  the  information 
will  be  enhanced.  (See  Appendix  A  for  CFA  model 
representation. ) 

Specifying  Input  and  Output  Measures 

The  most  important  step  in  analyzing  the  efficiency  of 
an  organization  is  the  specification  of  input  and  output 
measures.  Establishing  the  input  and  output  measures  will 
determine  the  success  of  the  efficiency  model.  Bessent, 
Bessent,  and  Clark  (1982)  provide  a  procedure  for  specifying 
inputs  and  outputs  for  DEA  or  the  CFA  model.  Figure  4 
provides  a  schematic  of  this  specification  process. 

The  input  and  output  measures  to  be  used  in  the 
efficiency  analysis  begin  with  the  description  of  the 
managerial  context.  The  managerial  context  is  described  by 
using  the  formal  statements  of  the  goals  and  services 
provided  by  the  DMU,  available  measures  used  in  the  current 
performance  measurement  system,  and  other  relevant  reports 
and  studies  that  may  produce  or  identify  potentially  useful 
measures  that  are  not  currently  being  used.  All  pertinent 


performance  measures  should  be  identified.  The  selected 
inputs  and  outputs  should  form  a  complete  representation  of 
the  DMU's  operation. 

Following  the  description  of  the  managerial  context,  a 
comprehensive  set  of  input  and  output  measures  must  be 
generated  based  on  the  managerial  context.  This  initial 
list  should  include  all  possible  candidates.  A  candidate 
measure  should  not  be  eliminated  unless  the  information  is 
already  contained  in  other  mesures.  The  following 
guidelines  should  be  followed  (Bessent,  Bessent,  and 
Clark;  1982): 

1.  Outputs  represent  important  DMU  goals. 

2.  All  measures  apply  to  all  DMUs  being  considered  and 
exist  in  non-zero  amounts. 

3.  Inputs  represent  all  resources  used  by  the  units 
towards  attainment  of  outputs. 

4.  Changes  in  inputs  will  result  in  a  corresponding 
change  in  outputs,  i.e.,  an  increase  in  an  input  results  in 
an  increase  in  output. 

5.  The  magnitude  of  physical  input/output  quantities 
are  represented. 

6.  The  quality  of  inputs  and  outputs  are  represented. 


All  possible  input  and  output  measures  must  be 
considered  because  of  the  problems  that  may  arise  if  a 
critical  input  or  output  is  eliminated  from  the  model. 


If  one  eliminates  (overlooks)  either  an  output  or  an 
input,  there  is  a  significant  risk  of  misclassif ication 
(wrong  frontier),  distorted  neighborhoods,  and 
erroneous  slack  conditions.  Elimination  of  an  output 
can  cause  unit  misclassif ications  and  incorrect  slack 
conditions  in  inputs .  Elimination  on  an  input  also 
causes  misclassif ications ,  but  the  erroneous  slack 
conditions  it  generates  will  appear  in  the  outputs . 
(Bessent,  Bessent,  and  Clark,  1982) 

Surplus  variables  are  the  multipliers  identified  in 

inefficient  units  by  the  DEA/CFA  process.  Erroneous  surplus 

variables  discredit  the  value  of  information  produced  by  the 

DEA/CFA  model. 

Once  a  list  of  all  possible  inputs  and  output  measures 
has  been  generated,  the  list  of  candidates  must  be  screened 
to  justify  the  acceptance  or  rejection  of  each  measure. 

This  is  a  critical  step  in  the  input/output  selection 
process.  The  entire  process  cannot  be  considered  complete 
until: 

1 .  The  list  of  input  and  output  measures  form  a 
reasonable  representation  of  the  key  efficiency  variables 
for  the  DMU. 

2.  The  input/output  set  chosen  forms  a  realistic 
representation  of  the  DMU's  operation. 

It  may  be  necessary  to  use  surrogate  measures  in  order 
to  capture  a  complete  representation  of  the  DMU’s  operation. 
Anthony  and  Herzlinger  (1980)  identify  three  measurement 
categories  in  which  output  measures  can  be  classified:  1 ) 
result  measures,  2)  process  measures,  and  3)  social 
indicators.  Result  measures  attempt  to  express  output  in 


terms  related  to  the  DMU's  objectives.  Ideally,  both  the 
objective  and  output  measure  can  be  expressed  in  the  same 
measurable  terms.  When  this  relationship  does  not  exist, 
then  the  accomplishment  of  the  objective  must  be 
represented  by  an  output  measure  that  most  closely 
represents  the  objective.  Such  a  measure  is  called  a 
surrogate.  A  surrogate  results  measure  is  an  "ends- 
oriented"  measure. 

A  process  measure  of  a  DMU's  output  is  a  "means- 
oriented"  indicator.  A  "means-oriented"  indicator  measures 
what  a  DMU  does  in  order  to  help  achieve  the  organizations' 
objectives.  This  type  of  output  measure  is  the  easiest  to 
interpret  because  there  is  a  close  causal  relationship 
between  inputs  and  process  measures.  They  can  only  be  used 
to  measure  efficiency  within  a  DMU,  but  not  effectiveness. 

Social  indicators  are  valuable  in  the  measurement  of  a 
DMU's  effectiveness,  but  does  not  apply  to  the  DEA/CFA 
efficiency  model.  Few  social  indicators  can  be  related  to  a 
single  organization  and  are  often  nebulous  and  difficult  to 
obtain,  therefore  will  be  excluded  from  consideration  in 
modeling  the  efficient  use  of  available  resources  within  a 
civil  engineering  oranization. 

Once  an  acceptable  set  of  measures  has  been 
established,  the  DEA/CFA  model  must  be  tested  to  demonstrate 
the  value  of  information.  If  an  acceptable  set  of  measures 
cannot  be  established,  or  if  acceptable  test  results  are  not 


achieved,  then  more  analysis  must  be  conducted  to  develop 
input  and  output  measure  candidates  that  more  successfully 
measure  the  efficiency  of  a  DMU.  If  acceptable  test  results 
are  obtained,  then  the  set  of  input/output  measure  should  be 
implemented  and  the  DEA/CFA  program  continued. 


Identifying  Input  and  Output  Measures  of  Available  Resources 

The  input  and  output  measures  for  the  efficient  use  of 
available  resources  can  now  be  identified  using  the 
guidelines  established  in  the  preceeding  discussion. 
Efficiency  measurement  is  new  to  the  civil  engineering 
career  field.  Resource  managers  do  use  many  performance 
indicators  in  their  day-to-day  operation  but  never  before 
have  efficiency  measures  been  identified  as  such.  The 
managerial  context  to  be  defined  i;:  this  efficiency  model 
will  be  the  measure  of  resource  availability  in  the 
accomplishment  of  the  Operations  Branch  support  of  the  civil 
engineering  mission.  The  Operations  Branch  is,  therefore, 
the  DMU  to  be  evaluated  by  the  CFA  model. 

As  stated  earlier,  the  mission  of  base  civil 
engineering  maintenance  management  is  to  "provide  the 
necessary  assets  and  skilled  personnel  to  prepare  and 
sustain  global  installations  as  stationary  platforms  for 
the  projection  of  aerospace  power"  (AFR  85-10,  1975).  The 
Operations  Branch  supports  this  mission  in  the  maintenance 
and  repair  of  base  facilities.  The  objective  of  the  civil 
engineering  unit  is  broadly  defined  in  AFR  85-1  (1982), 


Resources  and  Work  Force  Management,  as  providing 
engineering  support  for  the  base  mission.  The  Operations 
Branch  will  be  evaluated  in  the  performance  of  its  objective 
to  support  the  base  in  the  completion  of  all  facets  of 
maintenance  and  repair  of  base  facilities  using  available 
resource  measures.  Current  performance  measures  have  been 
adapted  to  input  and  output  measures  and  incorporated  in  the 
efficiency  analysis. 

Following  is  a  comprehensive  list  of  candidate  input 
and  output  measures  for  the  efficient  use  of  available 
resources.  This  list  was  generated  from  past  operational 
experience  of  the  author  and  validated  by  a  group  of 
experienced  civil  engineering  managers  attending  an 
Operations  Management  Applications  Course  at  the  Air  Force 
Institute  of  Technology,  School  of  Civil  Engineering 
(February,  1984). 


Outputs  Selected: 

Output  1 :  Number  of  Command  Interest  (Cl)  Work  Orders 
(WO)  completed. 

A  work  order  (as  defined  in  AFR  85-1 ) 
accomplished  in  support  of  a  special 
interest  project.  One  that  is  given 
priority  over  other  work  orders  due  to  the 
interest  of  the  wing,  base  or  civil 
engineering  commanders.  Result  measure. 


Output  2 :  Number  of  Routine  Work  Orders  completed 


Output  3 : 


Output  4 ; 


Output  5 : 


Output  6 : 


Output  7 : 


A  work  order  that  was  procr-.sed  in  a  normal 
sequence  and  procedure  as  defined  by 
AFR  85-1.  Result  measure. 

Number  of  Emergency  Job  Orders  completed. 

A  job  order  as  defined  by  AFR  85-1  .  Result 
measure. 

Number  of  Urgent  Job  Orders  completed. 

A  job  order  as  defined  by  AFR  85-1 .  Result 
measure. 

Number  of  Routine  Job  Orders  completed. 

A  job  order  as  defined  by  AFR  85-1  .  Result 
measure. 

Recurring  Maintenance  Program  Manhours 
completed. 

Measures  the  amount  of  labor  resources 
devoted  to  the  recurring  work  program  as 
described  in  AFR  85-1 .  Identifies  resources 
not  used  for  Work  or  Job  Orders.  Process 
measure . 

Utility  Operations  Manhours  completed. 
Measures  the  amount  of  labor  resources 
devoted  to  utility  operations.  Identifies 
resources  not  used  in  accomplishing  work 
orders  or  job  orders.  Process  measure. 
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Output  8:  Indirect  Manhours. 

Measures  the  amount  of  labor  resources 
diverted  from  accomplishing  maintenance  and 
repair  objectives.  A  surrogate  measure  of 
labor  and  resources  used  in  accomplishing 
tasks  not  related  to  objectives.  Indirect 
manhours  include  manhours  used  in  training, 
vehicle  and  shop  clean-up,  etc.  ...  (See 
AFR  85-1  for  complete  definition.)  Since 
manhours  is  also  an  input  measure,  indirect 
manhours  is  a  process  measure. 

Output  9 :  Average  cost  of  Command  Interest  Work 
Orders. 

A  process  measure  of  the  amount  of  resources 
used  in  accomplishing  maintenance, repair  and 
minor  construction  objectives.  Labor  and 
material  costs  are  included  in  this  output. 
The  average  cost  of  Cl  work  orders  can  be 
viewed  as  a  surrogate  measure  of  output. 

The  average  cost  of  Cl  work  orders  must  be 
included  because  of  the  wide  range  of 
scope  that  a  work  order  can  cover.  A 
base  that  does  only  several  very  large  Cl 
work  orders  would  look  inefficient  to  a  base 
that  does  many,  very  small  work  orders  when 


6 


only  the  number  of  Cl  work  orders  is  used  as 
an  output  measure. 

Output  10:  Average  cost  of  Routine  Work  Orders 


As  in  the  case  of  the  Cl  work  orders,  this 
output  must  be  included  as  a  surrogate 
measure  of  resources  used  in  accomplishing 
maintenance  and  repair  objectives.  Average 
cost  of  routine  work  orders  in  a  process 
measure  that  includes  both  labor  and  supply 
costs. 


Supply  Inputs  Selected: 

Input  1 :  Bench  Stock  Fill  Rate 


This  fill  rate  is  normally  determined  by 
dividing  the  number  of  bench  stock  bins 


Hr-* 


with  at  least  one  item  in  the  bin  by  the 
total  number  of  bins.  This  measure  is 
currently  used  by  many  organizations  to 
determine  the  availability  of  supplies  for 
doing  job  orders.  A  bench  stock  is  the 
civil  engineering  designation  for  a 
hardware  store.  Craftsmen  can  go  directly 
to  bench  stock  supplies  to  get  materials  to 
accomplish  a  job  order  without  having  to 
order  supplies  through  Material  Control. 


f.  • 
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against  that  requirement.  This  input 
measures  another  available  supply  resource 
for  accomplishing  work  orders  and  job 
orders. 

1  /  Material  Lead  Time. 

Material  lead  time  measures  how  quickly 
supply  items  are  procured  through  the 
material  control  supply  system.  The  lower 
the  material  lead  time,  the  faster  supply 
items  are  received.  The  reciprocal  of 
material  lead  time  is  used  as  an  input 
measure  to  establish  the  relationship  of 
increased  input  causing  an  increase  in 
output.  If  a  unit  lowers  its  material  lead 
time,  it  will  be  able  to  generate  more 
supply  resources,  hence,  should  be  able  to 
produce  greater  output  levels. 

Number  of  Work  Requests  received. 

This  measure  is  one  indicator  of  the 
workload  for  the  Operations  Branch.  Work 
Requests  <AF  Form  332)  are  submitted  to 
civil  engineering  by  customers  requesting 
work  to  be  done  in  their  facility.  Once  a 
work  request  is  approved,  it  becomes  a  work 


order  or  job  order.  Work  requests  are  used 
as  the  input  measure  instead  of  approved 


Input  6 


work  orders  because  every  work  request  must 
be  processed  whether  it  is  approved  or 
disapproved. 


Number  of  Command  Interest  Work  Orders 


Same  as  Input  7. 

Input  9:  Number  of  Routine  Job  Orders  received. 

Same  as  Input  7.  • 

Input  10:  Number  of  material  completed  Work  Orders  in 


the  Material  Control  Holding  Area 


A  material  complete  work  order  is  one  that 
has  been  processed  by  Material  Control  and 
all  parts  have  been  received.  This  input 
measures  the  amount  of  supply  resources  that 
are  ready  to  be  used  to  complete  a  work 


order  once  labor  manhours  become  available 


Material  complete  work  orders  also  give  one 
indicationof  the  backlog  of  work  to  be 
completed. 

Number  of  material  complete  Job  Orders  in 
the  Material  Control  Holding  Area. 

Same  as  Input  10. 

Number  of  Work  Orders  meeting  the  Required 
Delivery  Date. 

When  supplies  for  a  work  order  are  ordered 
through  Material  Control,  a  Required 
Delivery  Date  (RDD)  is  put  on  the  order. 

The  number  of  work  orders  meeting  their  RDD 
indicates  the  responsiveness  of  the 
material  control  supply  system. 

Number  of  Job  Orders  meeting  the  Required 
Delivery  Date. 

Same  as  Input  1 2 . 

Number  of  personnel  assigned  to  Material 
Control . 

This  input  deals  with  personnel  resources 
but  has  been  put  under  the  supply  inputs 
because  it  measures  the  amount  of  labor 
resources  devoted  to  supply  requisitions. 
The  number  of  personnel  assigned  to 


Material  Control  is  an  indication  of  the 
amount  of  supply  orders  being  processed. 
Input  15:  Ratio  of  personnel  assigned  to  authorized  in 

Material  Control. 

The  number  of  personnel  authorized  in  the 
Material  Control  section  is  determined  by 
the  Unit  Manpower  Document  (UMD).  The  ratio 
of  assigned  to  authorized  measures  the 
manning  strength  in  Material  Control. 


Vehicle  and  Equipment  Inputs  Selected: 

Input  1 6 ;  Number  of  vehicles  assigned. 

This  input  measures  the  size  of  the  vehicle 
fleet. 

Input  17;  Ratio  of  vehicles  assigned  to  authorized. 

The  ratio  of  vehicles  assigned  to  authorized 
measures  the  strength  of  the  vehicle  fleet. 
Input  1 8 ;  Vehicle  In  Commission  (VIC)  Rate. 

The  VIC  rate  is  computed  by  the 
Transportation  Squadron  which  performs  the 
maintenance  and  repair  of  civil  engineering 
vehicles.  This  input  measures  the  amount  of 
vehicles  that  are  operational. 

Input  19:  Number  of  Taxi  Vehicles. 


AFR  85-1  requires  civil  engineering 
squadrons  to  operate  a  taxi  service.  The 


taxi  service  is  controlled  by  the  Service 
Call  Unit.  Taxis  are  dispatched  to 
transport  craftsmen  between  job  sites  and 
shop  locations.  The  number  of  taxi  vehicles 
measures  the  size  of  the  taxi  service 
available. 

Input  20:  Number  of  taxi  runs. 

This  measure  indicates  how  much  the  taxi 
service  is  used  by  craftsmen  to  get  from  job 
site  to  job  site. 

Input  21 :  1  /  Average  wait  time  for  taxi. 

The  wait  time  for  a  taxi  is  determined  by 
how  long  a  craftsman  must  wait  for  the  taxi 
to  arrive  once  he  has  placed  a  call  to  the 
Service  Call  Unit  requesting  the  taxi 
service.  This  input  measures  the 
responsiveness  of  the  taxi  service.  The 
reciprocal  of  average  wait  time  is  used  so 
that  a  decrease  in  the  wait  time  will  relate 


Input  22 


!£ 


Input  23; 


Input  24; 


1  /  Average  age  of  vel 
The  age  of  the  vehicle  fleet  is  an 
indication  of  the  quality  of  the  vehicle 
fleet.  The  reciprocal  is  used  again  here  to 
establish  a  relationship  of  increased  inputs 
causing  an  increase  in  outputs. 

1  /  Average  number  of  miles  per  vehicle. 

This  input  also  measures  the  quality  of  the 
vehicle  fleet.  The  reciprocal  is  used  for 
the  same  reason  as  in  Input  22. 

1  /  Number  of  vehicles  on  recall  status. 

When  inspection  teams,  visiting 
distinguished  guests  or  training  exercises 
occur  on  an  Air  Force  base,  vehicles  are 
recalled  from  lower  priority  organizations 
to  be  used  by  higher  priority  organizations. 
Civil  engineering  is  one  of  the 
organizations  that  loses  vehicles  during 
recall  exercises.  The  number  of  vehicles  on 
recall  status  measures  the  amount  of  vehicle 
resources  lost  during  recall  exercises.  The 
reciprocal  measure  is  used  because  fewer 
vehicles  on  recall  status  will  increase  this 
input  measure. 


Input  25: 


Number  of  tool  boxes  assigned 


indicates  the  amount  of  tools  available  for 


Input  26: 


Input  27: 


Input  28; 


use  by  craftsmen. 

Ratio  of  number  of  tool  boxes  assigned  to 
authorized. 

The  ratio  of  tool  boxes  assigned  to 
authorized  indicates  how  many  craftsmen  who 
are  authorized  a  tool  box,  actually  have  one 
for  their  own  use.  The  higher  this  ratio, 
the  fewer  the  craftsmen  that  have  to  share 
tool  resources. 

Number  of  tool  boxes  over  90%  filled. 

A  tool  box  is  considered  90%  filled  if  that 
amount  of  the  authorized  tools  are  present 
in  the  box.  This  input  measures  the  quality 
of  tool  boxes. 

Number  of  Privately  Owned  Vehicles  (POV) 
authorized. 

Some  organizations  allow  craftsmen  to  drive 
their  own  vehicles  between  shop  locations 
and  job  sites.  The  craftsmen  are  then 
reimbursed  for  their  operating  expenses. 
Organizations  that  authorize  POV  use  will 
have  more  vehicle  resources  available  than 
if  they  did  not  authorize  POV  use. 


Personnel  Inputs  Selected: 


Input  29:  Number  of  military  skill  levels  filled 

Each  military  position  in  the  Operations 
Branch  has  an  authorized  skill  level.  The 
skill  level  of  a  position  is  the  measure  of 
expertise  required  for  that  position. 
Individuals  can  be  assigned  to  a  position 
with  a  lower  skill  level  than  that 
authorized  skill  level.  The  number  of  skill 
levels  filled  is  a  measure  of  the  number  of 
assigned  personnel  that  have  at  least  the 
required  skill  level  for  that  position  as 
indicated  by  the  authorized  skill  level  in 
the  UMD.  This  input  is  a  measure  of  the 
quality  of  the  workforce. 

Input  30:  Number  of  military  positions  with  correct 

grade  filled. 

Like  skill  level  requirements,  each  military 
position  has  an  authorized  grade  requirement 
in  the  UMD.  The  number  of  positions  with  at 
least  the  correct  grade  assigned  to  the 
positin  indicates  the  experience  level  of 
the  workforce.  It  is  another  indication  of 
the  quality  of  the  workforce  assigned  to  the 
positions  in  the  Operations  Branch. 


Input  31 :  Total  available  manhours. 

This  input  measures  the  amount  of  labor 
resources  available  for  use  in  completing 
work  requirements. 

Input  32:  Number  of  civilians  assigned. 

Civil  engineering  organizations  hire  a  lot 
of  civilian  employees.  This  input  measures 
the  size  of  the  civilian  workforce. 

Input  33:  Ratio  of  civilians  assigned  to  authorized. 

7  is  input  ratio  measures  the  strengh  of  the 
civilian  workforce. 


Input  34:  Number  of  military  assigned. 

This  input  measures  the  size  of  the  military 
workforce  within  the  Operations  Branch. 

Input  35:  Ratio  of  military  assigned  to  authorized. 

The  ratio  of  military  assigned  to  authorized 
measures  the  strength  of  the  military 
workforce. 

Input  36;  Ratio  of  military  assigned  to  civilians 
assigned. 

This  input  measures  the  relative  size  of  the 
military  workforce  to  the  civilian 
workforce.  This  input  measure  may  have  to 
be  reversed  if  the  analysis  of  the  data 
proves  that  a  lower  military  workforce  is 


more  efficient. 


Data  Population 

The  Constrained  Facet  Analysis  model  has  a  requirement 
for  the  number  of  observations  necessary  to  establish  an 
efficiency  frontier.  The  number  of  observations  required  is 
based  on  the  number  of  output  measures  (m)  and  the  number  of 
input  measures  (n).  The  minimum  number  of  observations 
required  is  2(m+n). 

From  the  comprehensive  list  of  output  and  input 
measures  for  resource  availability,  a  total  of  36  inputs  and 
10  outputs  were  selected  as  possible  candidates.  In  order 
to  correctly  measure  the  efficiency  of  a  unit's  resource 
availability,  a  total  of  2(10  +  36)  =  92  observations  would 
be  required  if  all  inputs  and  outputs  were  used  in  the 
efficiency  model. 

The  population  for  this  research  effort  is  the  Tactical 
Air  Command  (TAC)  bases.  There  are  a  total  of  1 8  TAC  bases 
in  the  CONUS.  By  collecting  data  from  each  base  over  a 
three  month  time  frame,  a  total  of  54  observations  were 
generated.  Fifty-four  observations  allowd  the  CFA  model  to 
use  a  maximum  of  27  input/output  measures  in  the 
determination  of  the  efficient  use  of  available  resources. 


The  input  and  output  measures  used  were  taken  from  the 
candidate  list  of  measures  previously  identified.  The  final 
list  of  input  and  output  measures  were  approved  by  the 
HQ/TAC  Civil  Enginering  staff  assisting  with  the  collection 


of  the  data.  Appendix  B  lists  the  18  bases  in  the  Tactical 
Air  Command. 

TAC  was  chosen  as  the  population  for  this  research 
effort  for  two  reasons.  First,  one  command  was  chosen 
instead  of  using  observations  from  all  Air  Force 
installations  in  the  CONUS  to  reduce  the  variability  caused 
by  different  major  commands  having  different  missions  and 
aircraft.  By  using  only  one  command,  the  mission  of  the 
installation  should  have  had  a  similar  effect  on  the  civil 
engineering  organizations  in  the  population.  Eliminating 
this  variability  improved  the  ability  to  compare  the 
different  organizations. 

The  second  reason  for  using  TAC  bases  as  the  population 
was  that  collecting  the  data  for  these  bases  was  simplified 
because  of  the  Work  Information  Management  System  (WIMS)  in 
use  at  TAC  Headquarters.  The  WIMS  has  been  in  use  at  TAC 
for  several  years.  Much  of  the  data  required  from  each  base 
was  already  being  processed  and  stored  in  the  memory  files  of 
the  TAC  system.  It  was  possible  to  collect  the  majority 
of  the  data  for  this  research  effort  directly  from  the 
memory  files  of  the  WIMS. 

Criteria  for  Evaluating  Research  Questions 

The  CFA  model  has  been  validated  and  proved  to  be  a 
valuable  management  tool  for  school  administrators  in  the 
Texas  School  Districts.  The  information  provided  by  the  CFA 
model  has  helped  identify  the  inefficient  units  and  the 
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inputs /outputs  that  were  contributing  to  the  inefficient 
ratings.  The  purpose  of  the  research  effort  was  to  find  out 
if  the  CFA  model  can  identify  inefficient  use  of  available 
resources  in  civil  engineering  organizations.  More 
specifically/  the  purpose  of  this  research  effort  was  to 
provide  information  to  the  managers  of  the  Operations  Branch 
on  how  they  can  more  efficiently  use  their  labor,  vehicles, 
equipment,  and  supply  resources  to  accomplish  their 
objective  of  performing  maintenance  and  repair  of  base 
facilities. 

The  data  collected  from  TAC  bases  was  analyzed  to 
answer  the  research  questions  as  stated  in  previous 
sections.  The  CFA  model  helped  identify  which  variables 
have  the  greatest  effect  on  the  efficient  use  of  available 
resources. 

The  variables  considered  to  be  inputs  and  outputs  were 
selected  by  the  HQ/TAC/DE  staff.  The  weights  assigned  to 
the  inputs  and  outputs,  as  already  stated,  were  determined 
by  the  CFA  model  when  it  assigned  multiplier  values  to  the 
inputs  and  outputs.  The  CFA  model  was  developed  to  take 
into  account  the  interactions  between  variables.  The 
significance  of  each  output  and  input  variable  was 
determined  by  the  CFA  model  and  was  unique  for  each 
organization. 

Finally,  the  purpose  of  the  CFA  model  was  to  identify 
inefficient  units  and  their  surplus  input  quantities  or 


output  shortages.  The  surpluses  or  shortages  were  the  areas 
that  the  inefficient  units  should  concentrate  on  improving. 
It  was  hoped  that  results  of  the  CFA  model  would  prove  to  be 
a  valuable  tool  to  civil  engineering  managers  by  identifying 
the  inefficient  use  of  available  resources.  It  must  be 
stressed  that  this  model  is  a  management  tool,  for  use  at 
both  the  major  command  (MAJCOM)  and  base  level,  that 
provides  information  to  managers  on  how  they  are  using  their 
available  resources  in  comparison  with  other  similar 
organizations.  The  manager  will  still  be  responsible  for 
analyzing  the  information  and  determining  the  appropriate 
actions  necessary  to  improve  the  efficiency  and 
effectiveness  of  his  organization. 


IV.  Selection  of  Output  and  Input  Measures  and 

Data  Collection 


Introduction 

This  chapter  presents  a  description  of  the  final 
selection  of  output  and  input  measures  for  modeling  the 
efficient  use  of  available  resources  in  a  civil  engineering 
unit.  The  Tactical  Air  Command  Civil  Engineering  Staff 
(HQ  TAC/DE)  was  the  final  selection  authority  for  the  outuput 
and  input  measures.  This  was  necessary  in  order  to  obtain 
approval  of  using  the  TAC  bases  as  the  data  population.  The 
HQ  TAC/DE  personnel  collected  and  screened  the  data  for  the 
selected  output  and  input  measures  before  forwarding  the 
data. 

The  output  and  input  measures  selected  were  based  on 
the  judgement  of  the  HQ  TAC/DE  personnel.  The  measures 
selected  were  those  measures  that  best  described  the 
available  resources  of  a  civil  engineering  unit  at  the  TAC 
bases.  Several  measures  had  to  be  refined  so  that  data 
could  be  collected  and  some  candidate  measures  were 
eliminated  due  to  the  nature  of  TAC  operating  procedures. 

The  final  set  of  measures  is  a  comprehensive  list  of  8 
output  measures  and  1 6  input  measures  which  best  describes 
the  available  resources  in  a  civil  engineering  unit. 


Minor  Construction  Work  Orders 
completed 

Other  Work  Orders  completed 
Emergency  Job  Orders  completed 
Urgent  Job  Orders  completed 
Routine  Job  Orders  completed 
Recurring  Work  completed 
Utility  Operations 
Indirect  hours 


The  data  for  these  output  measures  could  easily  be 
collected  from  the  TAC  bases  on  a  month  to  month  basis. 


These  eight  output  measures  describe  the  output  of  a  civil 
engineering  unit  as  a  process,  not  in  terms  of  results  and 


therefore,  are  actually  surrogate  measures  of  output.  It 
was  felt  that  the  data  on  the  candidate  set  of  output 
measures  would  not  be  available  since  it  is  not  a 
requirement  to  collect  that  data  at  TAC  bases.  The  decision 
was  made  to  substitute  the  eight  measures  of  manhour  use  as 
the  output  measures  for  the  efficiency  model. 


Inputs  Selected 

The  final  list  of  input  measures  selected  was  a  set  of 
measures  developed  by  eliminating  and  combining  the  input 
measures  from  the  candidate  set  of  measures  described  in 
Chapter  III.  The  candidate  list  of  input  measures  was 
developed  without  taking  into  account  any  particular 
command's  operating  procedures.  Several  of  the  candidate 
input  measures  were  eliminated  because  of  the  characteristic 
operating  procedures  of  the  TAC. 

The  input  measure  on  Bench  Stock  Fill  rate  is  not 
applicable  to  the  majority  of  the  TAC  bases.  Sixteen  of  the 
eighteen  bases  are  under  Contract  Operated  Civil  Engineering 
Supply  Store  (COCESS)  procedures  and  do  not  collect  data  on 
fill  rates.  The  contractor  is  required  to  maintain  stock 
levels  as  specified  in  the  contract. 

Data  on  material  lead  time  and  required  delivery  dates 
is  not  collected  at  TAC  bases.  The  HQ  TAC/DEMG  staff 
believed  that  this  information  would  not  be  available  at  the 
base  level  and  therefore,  eliminated  the  input  measures 
requiring  that  data. 


Several  of  the  candidate  input  measures  do  not  fall 
under  the  responsibility  of  the  Civil  Engineering  Unit  at 
TAC  bases.  The  Transportation  Squadron  is  responsible  for 
all  of  the  base  taxi  service  and  the  Base  Supply  Tool 
Control  is  responsible  for  the  control  of  all  tool  issues  at 
TAC  bases.  Hence ,  the  input  measures  of  taxi  services  and 
tool  issue  were  eliminated  from  the  set  of  input  measures. 

From  the  remaining  list  of  input  measures,  a  final  set 
of  1 6  input  measures  was  developed.  This  list  was  developed 
by  the  HQ  TAC/DEMG  staff  by  combining  some  input  measures  and 
by  eliminating  those  measures  that  were  not  considered 
relevant,  or  for  which  data  was  not  readily  available. 

One  area  that  was  overlooked  on  the  candidate  set  of 
measures  was  the  number  of  overhires  used  in  the  Operations 
Branch.  An  overhire  is  a  person  hired  on  a  part-time  basis 
to  augment  the  assigned  number  of  personnel.  This  measure 
was  included  as  one  of  the  final  input  measures.  See  Table 
4.2  for  the  list  of  input  measures  selected. 

Data  Collection 

HQ  TAC/DEMG  distributed  by  message  a  request  for  data 
collection  on  the  input  and  output  measures  of  available 
resources  from  the  18  bases  in  the  Tactical  Air  Command. 

(See  Appendix  C  for  message  requesting  data.)  Data  was 
collected  for  the  months  of  March,  April  and  May  from  each 
of  the  bases.  The  data  for  each  month  was  first  collected 


TABLE  4.2 


Input  Measures  Selected 


Input;  Description: 

1.  §  of  Bench  Stock  line  items  (GOCESS,COCESS, 
and  Base  Supply) 

2.  #  of  Work  Requests  received 

3.  #  of  Job  Orders  received 

4.  #  of  material  complete  Work  Orders 

5.  #  of  material  complete  Job  Orders 

6.  #  of  General  Purpose  vehicles  assigned  to  the 
Operations  Branch 

7.  Ratio  of  vehicles  assigned  to  authorized 

8.  1 /average  age  of  General  Purpose  vehicles 

9.  #  of  skill  levels  filled  (Military  personnel 

in  the  Operations  Branch) 

10.  #  of  positions  with  correct  grade  filled 
(Military  personnel  in  the  Operations  Branch) 

11.  Total  available  manhours 

12.  §  of  civilians  assigned  to  the  Operations 
Branch  (exclude  overhires) 

13.  #  of  civilian  overhires  assigned  to  the 
Operations  Branch 

14.  Ratio  of  civilians  assigned  to  authorized (all) 

15.  #  of  Military  personnel  assigned  to  the 
Operations  Branch 

16.  Ratio  of  Military  assigned  to  authorized 


by  HQ  TAC/DEMG  staff  and  then  forwarded  to  AFIT  where  it  was 
loaded  into  AFIT's  Cyber  computer  system.  Appendix  D 
contains  a  complete  listing  of  the  data  file.  Each  base  did 
collect  the  required  data  elements  for  the  desired  months 
for  a  100%  return  rate.  Therefore,  a  total  of  54 
observations  were  loaded.  Each  base  had  three  observations, 
designated  for  the  months  of  March,  April  and  May  as  "Base 
name"  1,  2,  and  3  respectively. 


The  data  file  was  formated  to  meet  the  requirements  of 
the  CFA  programming  code  at  the  University  of  Texas,  Austin, 
Texas.  The  CFA  program  is  loaded  on  a  Cyber  comp  iter  system 
similar  to  the  AFIT  Cyber  system.  The  first  seven  lines  in 
the  data  file  describes  the  format  of  the  data  to  be  read. 
Line  1  is  the  title  of  the  data  file  and  line  2  contains 
that  number  of  observations  to  be  read  (54),  the  number  of 
outputs  (15),  and  the  number  of  inputs  (16)  for  each 
observation. 

There  is  a  total  of  1 5  outputs  in  the  data  file  because 
the  final  8  output  measures  were  added  together  to  make  4 
combined  output  measures.  The  output  measures  were  combined 
to  give  some  flexibility  in  the  number  of  output  measures 
used  in  the  efficiency  model.  Output  A  is  the  sum  total  of 
direct  manhours  ( summation  of  outputs  1  through  7 ) .  Output 
B  is  the  total  manhours  used  for  work  orders  completed 
(output  1  and  2).  Output  C  is  the  total  manhours  used  for 
job  orders  completed  (outputs  3,  4,  and  5),  and  output  D  is 
the  total  manhours  used  for  recurring  work  and  utility 
operations  (outputs  6  and  7).  Outputs  E,  F,  and  G  are  empty 
data  fields  that  were  required  to  maintain  the  proper  data 
format.  By  combining  the  outputs  as  described,  the 
efficiency  model  can  use  two,  four,  or  eight  outputs  and 
still  contain  all  of  the  direct  and  indirect  manhours. 

Lines  3  through  7  in  the  data  file  describe  the  order 
in  which  the  output  and  input  measures  will  be  read  for  each 


observation.  In  this  data  file,  outputs  A  through  G  will  be 
read  from  the  first  line  of  data,  followed  by  outputs  1 
through  8  and  then  inputs  1  through  16.  In  the  data  record 
of  each  observation,  the  first  line  is  the  record  identifier 
(the  name  of  the  base  followed  by  the  suffix  corresponding 
to  the  appropriate  month).  Each  record  identifier  is 
followed  by  five  lines  of  data.  The  first  12  columns  of 
each  line  contain  the  record  identifier  for  the 
corresponding  observation.  Following  the  record  identifier 
is  the  output  and  input  measures  in  the  order  described  in 
the  formatting  statement  in  lines  3  through  7. 


V.  Analysis  and  Results 


Introduction 

This  chapter  contains  the  analysis  and  results  of  the 
data  in  modeling  the  efficient  use  of  available  resources  in 
the  Operations  Branch  of  a  Base  Civil  Engineering  Squadron. 
The  analysis  of  the  program  executions  was  conducted  at  the 
University  of  Texas,  Austin,  from  25  to  28  June  1984.  Dr. 
Authella  Bessent  and  Dr.  Wailand  Bessent,  Co-Directors  of 
the  Educational  Productivity  Council  (supports  the  research 
and  maintenance  of  the  CFA  code),  were  available  to  assist 
in  the  execution  of  the  CFA  program.  The  results  of  the 
program  executions  will  be  used  to  answer  the  research 
questions.  Each  research  question  is  analyzed  separately. 

CFA  Program  Execution 

The  CFA  execution  commands  were  designed  to  add 
flexibility  in  the  analysis  of  the  data  within  an  efficiency 
model.  Once  the  data  file  is  correctly  loaded,  the  CFA  code 
initializes  the  program  execution  by  asking  the  user  a  set 
of  five  questions. 

The  first  question  asks  the  user  to  specify  the 
decision  making  units  (DMUs)  to  be  included  in  the  reference 
set.  The  units  the  user  specifies  will  be  the  only  units 
from  the  data  file  that  will  be  used  in  the  efficiency 
model.  The  user  has  the  option  of  specif ing  a  given  set  of 
DMUs  or  he  can  use  all  of  the  DMUs  in  the  reference  set. 


All  of  the  DMUs  were  included  in  the  reference  set  in  the 
program  execution  for  modeling  the  efficient  use  of  available 
resources . 

The  second  question  asks  the  user  to  specify  the  DMUs 
to  be  processed.  The  user  has  the  option  of  processing  a 
given  set  of  DMUs  or  all  of  the  DMUs  from  the  reference  set. 
Efficiency  ratings  and  output  reports  are  generated  only  for 
the  units  specified  to  be  processed.  This  allows  the  user 
to  run  reports  for  only  the  inefficient  units,  and  does  not 
have  to  waste  execution  time  on  the  efficient  units  from  the 
reference  set.  If  a  unit  is  not  specified  in  the  reference 
set,  it  cannot  be  processed.  The  initial  program  executions 
for  modeling  the  efficient  use  of  available  resources 
specified  all  of  the  DMUs  to  be  processed.  Once  the 
inefficent  units  were  determined,  a  second  program  execution 
was  conducted  to  generate  the  reports  for  the  inefficient 
units . 

The  CFA  program  then  requests  the  user  to  choose  the 
outputs  and  inputs  to  be  used  in  the  efficiency  model. 

These  two  questions  allow  the  user  to  choose  a  subset  of  the 
output  and  input  measures  in  the  determination  of  efficiency 
for  the  DMUs  in  the  reference  set.  The  user  has  the  option 
of  specifying  a  subset  or  all  of  the  output  and  input 
measures  in  the  efficiency  model.  Various  combinations  of 
output  and  input  measures  were  used  in  the  modeling  of 
efficient  use  of  available  resources. 


The  final  question  of  the  executive  commands  asks  the 
user  to  specify  which  reports  are  to  be  executed.  There  are 
two  reports  generated  for  each  unit  specified  to  be 
processed.  The  first  report  is  the  output  change  report. 
This  report  identifies  changes  required  in  the  output  levels 
of  a  DMU  in  order  to  become  efficient  if  the  input  levels 
remained  constant.  The  second  report,  the  input  change 
report,  identifia?.  the  changes  required  in  the  input  levels 
of  a  DMU  in  order  to  become  efficient  if  the  output  levels 
remained  constant.  The  user  has  the  option  of  specifying 
the  output  change  reports,  input  change  reports,  both,  or  no 
reports.  For  this  research  effort,  both  reports  were 
requested  when  the  change  reports  were  desired  for  a  given 
program  execution. 

The  output  and  input  change  reports  were  generated  by 
printing  the  output  file  once  the  program  had  executed.  The 
output  file  listed  all  command  statements  and  responses,  and 
the  change  reports  for  the  units  specified  to  be  processed. 
The  CFA  model  also  generates  a  summary  file  and  a  lambda 
file  that  the  user  has  the  option  of  executing. 

The  summary  file  is  a  summary  of  the  efficiency 
ratings,  multiplier  and  surplus  values  for  each  unit 
specified  to  be  processed.  Appendix  E  contains  a  summary 
file  for  a  program  execution  which  specified  processing  all 
of  the  DMUs  in  the  reference  set  with  a  subset  of  output  and 
input  measures.  The  second  line  in  the  summary  file 


identifies  the  number  of  units  in  the  data  file  (54),  the 
number  of  outputs  used  ( 4 ) ,  and  the  number  of  inputs  used 
(7).  Lines  3  and  4  identify  which  outputs  and  inputs  were 
selected  for  the  program  execution. 

Following  the  execution  statements,  a  summary  record  is 
generated  for  each  DMU.  For  this  program  execution,  each 
DMU  has  a  summary  record  of  seven  lines.  The  lower  and 
upper  bound  efficiency  rating  is  found  at  the  end  of  the 
line  0.  Lines  1  and  4  contain  the  observed  values  for  the 
output  and  input  measures  in  the  order  specified  in  the 
execution  statements.  Lines  2  and  5  contain  the  multiplier 
values,  Urk  and  ,  for  the  output  and  input  measures 
associated  with  DMU  .  The  surplus  values,  Srk  ,  Sik 
associated  with  the  output  and  inputs  of  DMU  are  found  on 
lines  3  and  6.  These  multiplier  and  surplus  values  are 
generated  by  the  CFA  model  and  are  used  to  generate  the 
output  and  input  change  reports  in  the  output  file.  (See 
Appendix  A  for  explanation  of  CFA  terms . ) 

The  lambda  file  specifies  the  inefficient  units  within 
the  reference  set  and  identifies  those  units  that  lie  on  the 
efficiency  frontier  closest  to  the  inefficient  unit. 

Appendix  F  is  the  lambda  file  associated  with  the  summary 
file  in  Appendix  E.  The  lambda  file  identifies  all  the 
inefficient  units  determined  in  the  program  execution  using 
outputs  B,  C,  D,  8  and  inputs  1,  3,  6,  9,  11,  13,  and  15. 

For  example,  Englandl  was  determined  to  be  inefficient. 


The  efficient  units  on  the  efficiency  frontier  closest  to 
Englandl  are,  therefore,  Sey  John2,  Hollomanl ,  Moody 1 , 
Nellisl ,  Luke3,  Langleyl ,  Davis  Monl ,  and  Davis  Mon3. 

The  value  to  the  right  of  the  efficient  units  is  the  value 
of  the  vector  from  England  1  to  the  efficient  units. 

CFA  Code  Limitations 

The  initial  program  executions  attempting  to  use  all  8 
output  and  16  input  measures  for  modeling  the  efficient  use 
of  available  resources  were  unsuccessful.  It  was  discovered 
that  the  CFA  program  code  had  been  written  using  a  matrix 
dimension  of  20.  The  matrix  is  used  to  perform  the  linear 
programming  calculations.  The  CFA  program  would  not  accept 
the  initial  program  executions  because  they  contained  24 
constraints,  one  associated  with  each  output  and  input 
measure,  and  would  not  fit  in  the  matrix  dimensioned  for 
only  20  outputs  and  inputs. 

The  dimensioning  problem  was  unique  for  the  CFA 
efficiency  model.  For  the  first  time  a  large  set  of  output 
and  input  measures  were  being  used.  The  CFA  model  had  only 
been  used  to  model  efficiencies  in  organizations  with  3 
output  measures  and  10  input  measures.  The  CFA  program 
itself  could  handle  more  than  20  output  and  input  measures, 
but  the  computer  program  had  been  dimensioned  for  a  maximum 
of  20  output  and  input  measures.  Doctors  A.  Bessent  and  W. 
Bessent  did  make  several  attempts  to  redimension  the  CFA 
program  code,  but  their  efforts  were  unsuccessful.  The  CFA 


The  unforseen  problem  of  the  CFA  code  dimension 
limitations  made  it  necessary  to  reevaluate  the  output  and 
input  measures  and  reduce  the  number  of  measures  so  that  the 
CFA  program  could  execute  the  data.  The  CFA  program  had  the 
flexibility  of  specifying  a  subset  of  outputs  and  inputs 
built  into  the  executive  commands.  By  choosing  a  subset  of 
less  than  20  output  and  input  measures,  the  CFA  program 
would  execute  on  the  data  file  and  produce  the  required 
efficiency  ratings  for  the  DMUs  in  the  data  file. 

Since  the  8  output  measures  had  been  combined,  there 
was  some  added  flexibility  in  the  number  of  output  measures 
that  could  be  specified.  By  using  output  A,  direct 
manhours,  and  output  8,  indirect  manhours,  only  two  outputs 
could  be  used  to  describe  all  of  the  output  processes  for  a 
Civil  Engineering  Operations  Branch.  The  problem  with  using 
two  output  measures  is  that  it  limited  the  variation  in 
output  between  the  organizations.  The  aggregation  of  output 
measures  compacted  the  variation  in  resources  used  to 
accomplish  the  output  processes. 

A  better  combination  of  aggregated  output  measures  was 
output  B,  manhours  used  in  completion  of  Work  Orders;  output 


C,  manhours  used  in  completion  of  Job  Orders;  output  D, 
manhours  used  in  Recurring  Work  and  Utility  Operations;  and 
output  8,  Indirect  Manhours.  This  combination  of  outputs 
aggregated  the  output  processes,  yet  still  allowed  for 
variation  between  organizations.  Of  all  the  combinations  of 
output  measures  tested,  the  use  of  these  four  outputs 
produced  the  best  results  in  the  model. 

Unlike  the  output  measures,  the  input  measures  for  the 
efficiency  model  could  not  be  aggregated  because  each  input 
was  not  measured  with  the  same  unit  of  measure.  All  of  the 
outputs  were  measured  in  manhours  and,  therefore,  could  be 
combined.  The  input  measures  included  a  variety  of 
measures.  As  stated  earlier,  a  subset  of  input  measures 
could  be  specified  by  the  user  in  order  to  reduce  the  number 
of  inputs. 

The  CFA  model  recommended  that  there  be  at  least  two 
observations  for  every  one  output/input  measure  used  in  the 
efficiency  model.  By  using  only  four  output  measures,  all 
16  input  measures  could  be  used  in  the  efficiency  model. 
Using  20  output  and  input  measures  with  54  observations  did 
meet  the  model  requirements,  but  it  was  discovered  that  a 
ratio  of  observations  to  output/input  measures  that  is  close 
to  2.0  did  not  produce  very  many  inefficient  units.  When  4 
output  measures  and  1 4  input  measures  were  used  in  the 
program  execution,  only  5  out  of  the  54  units  were  rated  as 
inefficient . 


Tests  using  reduced  numbers  of  output  and  input 
measures  produced  results  that  identified  more  inefficient 


units.  When  there  is  a  low  ratio  of  observations  to 
output/input  measures,  there  are  so  many  combinations  of 
output  and  input  measures  that  every  unit  can  look  efficient 
on  some  part  of  the  efficiency  frontier.  By  reducing  the 
number  of  output  and  input  measures,  the  number  of 
combinations  is  reduced,  thus  limiting  the  number  of  units 
that  can  reach  the  efficiency  frontier. 

Pearson  Correlation  Results 

In  order  to  justify  the  elimination  of  input  measures, 
the  subprogram  for  a  Pearson  Correlation  from  the 
Statistical  Package  for  the  Social  Sciences  (SPSS)  was 
calculated  for  the  input  measures  paired  with  the  output 
measures.  The  results  of  the  Pearson  Correlation  produced 
several  interesting  relationships  between  the  input  measures 
and  output  measures.  From  these  results  the  input  measures 
were  systematically  eliminated  from  the  efficiency  model. 

The  Pearson  Correlation  measures  the  strength  of  the 
relationship  between  two  variables.  A  high  positive  value 
corresponds  to  a  strong  relationship  between  variables.  A 
value  close  to  zero  means  there  is  little  relationship 
between  the  two  variables.  A  negative  correlation  between 
variables  indicates  an  opposite  relationship  between 
variables.  For  the  efficiency  model  variables,  a  positive 
correlation  would  indicate  that  an  increase  in  the  input 


variable  corresponds  to  a  positive  effect  on  output,  a  zero 
correlation  would  indicate  no  relationship  between  input  and 
output,  and  a  negative  correlation  would  mean  that  an 
increase  in  the  input  variable  would  lead  to  a  decrease  in 
the  output  variable. 

Upon  completion  of  the  Pearson  Correlation  on  the  data 
file,  it  was  found  that  there  was  a  negative  correlation 
between  several  of  the  input  measures  and  the  output 
measures.  Input  measures  14  and  16  had  a  negative 
correlation  with  the  majority  of  the  output  measures. 
Referring  back  to  the  list  of  input  measures,  input  1 4  is 
the  ratio  of  civilians  assigned  to  the  number  of  authorized, 
and  input  1 6  is  the  ratio  of  military  assigned  to  the  number 
authorized.  The  Pearson  Correlation  suggested  that  as  the 
ratio  of  personnel  assigned  to  the  number  authorized 
increases,  the  output  for  a  unit  decreases.  Logically  this 
result  makes  sense  because  as  a  unit  gets  closer  to  filling 
all  of  its  authorized  positions,  or  possibly  has  more 
assigned  than  authorized,  the  productivity  of  each 
individual  will  decrease  since  they  will  not  have  to  do  as 
much  work  as  when  the  organization  was  undermanned.  Due  to 
this  negative  relationship  between  input  and  output,  inputs 
14  and  16  were  not  used  in  the  efficiency  model. 

Another  input  measure  that  produced  a  negative 
correlation  with  the  majority  of  the  output  measures  was 
input  4,  the  number  of  material  complete  Work  Orders  in  the 


Material  Control  holding  area.  Input  4  had  a  positive 
correlation  for  the  outputs  that  measured  the  number  of 
manhours  used  for  completing  Work  Orders,  outputs  1,  2,  and 
B,  but  there  was  a  high  negative  correlation  between  input  4 
and  the  rest  of  the  output  measures.  Again,  this  result 
logically  makes  sense  because  the  number  of  material 
complete  Work  Orders  will  only  increase  output  used  for 
completing  Work  Orders,  and  will  detract  from  the  output 
used  for  the  other  output  processes.  Hence,  input  4  could 
still  be  considered  as  an  alternative  input  measure  for  the 
efficiency  model. 

The  Pearson  Correlation  also  revealed  some  other 
interesting  relationships  between  input  variables.  A  high 
positive  correlation  existed  between  several  of  the  input 
variables.  Input  9  and  input  10  had  a  correlation  of  .9384 
which  indicates  a  very  high  positive  relationship  between 
the  two  variables.  Input  9  measured  the  number  of  military 
positions  with  the  correct  skill  level  filled,  and  input  10 
measured  the  number  of  military  positions  with  the  correct 
grade  filled.  There  was  also  a  high  positive  correlation 
(.8531)  between  input  9  and  input  15,  the  number  of  military 
assigned,  and  between  input  10  and  15  (.8235).  Input  11, 
the  total  available  manhours,  and  input  12,  the  number  of 
civilians  assigned,  also  had  a  strong  positive  correlation 


As  stated  earlier,  a  high  positive  correlation 
indicates  a  strong  relationship  between  variables.  In  the 
efficiency  model,  a  high  positive  correlation  indicates  that 
the  two  variables  are  closely  related  and,  therefore,  only 
one  of  the  variables  need  to  be  used  an  an  input  measure. 

In  this  case,  input  9  could  be  used  as  an  input  measure  and 
inputs  10  and  15  could  be  eliminated  from  the  list  of  input 
measures.  Also,  input  11  could  be  used  and  input  12  could 
be  eliminated.  This  reduces  three  of  the  input  measures  in 
the  efficiency  model  by  discarding  the  input  measures  that 
are  already  represented  in  other  input  measures. 


Research  Question  1 

"Which  variables  describe  a  unit's  available  resources? 

From  the  candidate  list  of  output  and  input  variables, 
24  variables  were  selected  as  the  output  and  input  measures 
for  modeling  the  efficient  use  of  available  resources.  Due 
to  the  limitations  of  the  CFA  program  code,  all  of  the 
output  and  input  measures  could  not  be  used.  Further 
reductions  in  the  list  of  measures  had  to  be  made  before  the 
program  could  be  executed  on  the  data  file. 

The  output  measures  were  reduced  by  combining  the  8 
original  output  measures  into  4  output  measures.  Table  5.1 
shows  the  final  set  of  output  measures  used  in  the 
efficiency  model  for  available  resources.  By  aggregating 
the  output  processes  into  these  four  outputs,  the 
description  of  the  Operations  Branch  was  maintained. 


TABLE  5.1 

Reduced  Output  Measures 

1,1  - 

t 

r: 

■  **- 

Data  File 

•  *  * 

Output 

Description 

Identifier 

1  ... 

1 

Manhours  used  in  completing 

Minor  Construction  and  Other 

Work  Orders 

Output  B 

2 

Manhours  used  in  completing 
Emergency,  Urgent,  and  Routine 

Job  Orders 

Output  C 

1 

3 

Manhours  used  for  Recurring  Work 
and  Utility  Operations 

Output  D 

d 

4 

Indirect  manhours 

Output  8 

•  v -i.  • 

The  input  measures  could  not  be  reduced  by  combining 
various  inputs.  The  input  measures  were  reduced  by 
comparing  input  variables  using  the  Pearson  Correlation 
results.  Several  input  measures  were  eliminated  because 
there  was  a  negative  relationship  between  the  input  measure 
and  outputs.  Other  input  measures  were  discarded  because 
there  was  a  high  positive  correlation  between  input 
measures.  The  final  set  of  input  measures  used  in  the 
efficiency  model  contained  seven  input  measures.  The  seven 
inputs  measures  in  Table  5.2  were  the  input  measures 
selected  based  on  the  Pearson  Correlation  results.  The 
seven  measures  showed  the  highest  correlation  with  the 
output  measures. 
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TABLE  5.2 


Reduced  Input  Measures 


Data  File 

Input 

Description 

Identifier 

1 

Number  of  Bench  Stock  Line  Items 
(COCESS,  GOCESS,  and  Base  Supply) 

Input 

1 

2 

Number  of  Job  Orders  received 

Input 

3 

3 

Number  of  Vehicles  assigned 

Input 

6 

4 

Number  of  military  positions 
at  least  the  correct  skill 

Input 

9 

level  filled 

5 

Total  available  manhours 

Input 

1 1 

6 

Number  of  civilian  overhires 

Input 

13 

7 

Number  of  military  assigned 

Input 

15 

Research 

Question  2 

"How  will  the  variables  be  weighted?" 


As  stated  in  previous  discussions,  it  is  not  necessary 
to  assign  weights  to  the  output  and  input  variables.  The 
weight  assigned  to  an  output  or  input  variable  is  determined 
by  the  CFA  model.  The  weighting  assigned  to  each  variable 
is  unique  for  each  organization  based  on  how  that 
organization  is  using  its  available  resources  in  comparison 
with  the  other  organizations  in  the  reference  set. 

Appendix  E  contains  a  summary  file  for  the  CFA  model 
executed  on  the  data  for  available  resources  using  the 
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output  and  input  measures  identified  in  Research  Question  1 
The  multiplier  values  for  each  output/input  measure  are 
found  on  lines  2  and  5  in  the  data  record  for  each  DMU. 
These  values  are  determined  in  the  linear  progamming 
calculations  of  the  CFA  model.  The  multiplier  values  are 
used  to  determine  the  relative  importance  of  the 
output/input  measure  found  in  Change  Reports  for  the  given 
DMU. 

Table  5.3  is  an  Output  Change  Report  for  DMU  1.  The 
"percent  contribution  to  efficiency"  represents  the 
weighting  assigned  to  each  output  variable  for  DMU  1 .  The 
percent  contribution  is  calculated  by  multiplying  the 
observed  value  of  the  output  measure  by  the  multiplier 
value  for  that  output  measure.  For  example,  output  C 
contributes  42.3  percent  to  the  efficiency  of  DMU  1.  From 
the  summary  file  in  Appendix  E,  the  multiplier  value, 
for  output  C  for  Bergstrom  1  is  .000032  and  the  observed 
value  for  output  C  is  13287.0.  Multiplying  the  observed 
value  by  the  multiplier  value  equals  the  percent 
contribution  to  efficiency. 

Percent  =  multiplier ,  Urk  x  observed  x  100% 

Contribution  value  value 

to  efficiency 


42.3% 


( .000032) 


x 


(13287.0)  x  100% 


There  will  be  slight  difference  in  the  calculated  values  due 
to  rounding  errors. 

The  same  principle  holds  true  for  the  input  measures. 
The  "relative  importance  of  inputs",  which  represents  the 
weighting  of  the  input  measure,  is  determined  by  multiplying 
the  observed  value  by  the  multiplier  value,  .  For  input 

6  in  the  DMU  1  Output  Change  Report  in  Table  5.3,  the 
relative  importance  equals  27.0%. 

Relative  =  multiplier  x  observed  :  100% 

Importance  value  value 

of  Inputs 

27.0%  *  (.006933)  x  39.0  x  100% 

Research  Question  3 

"Which  variables  significantly  impact  the  efficient  use 
of  available  resources?" 

As  pointed  out  in  Research  Question  2,  the  CFA 
efficiency  model  assigns  weights  to  each  output  and  input 
variable  for  a  given  DMU  based  on  a  simultaneous  comparison 
of  all  DMUs .  The  weights  are  determined  by  using  the 
multiplier  values,  Urk  and  ,  generated  by  the  CFA  model. 
The  weights  assigned  to  each  output/input  variable  is  unique 
for  the  DMU  being  evaluated.  The  relative  importance 
assigned  to  a  variable  will  vary  between  DMUs.  The  CFA 
model  is  unique  in  the  fact  that  it  determines  the 
importance  of  a  variable  based  on  observed  values  for  DMUs 
being  evaluated. 
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TABLE  5.3 


Output  Change  Report  for  DMU  1 


MODEL  EFF  OF  AVAIL  RES 
DECISION  MAKING  UNIT  1 

********************** 

*  SUMMARY  OF  RESULTS  * 
********************** 

EFFICIENCY  RANGE  *  87.4  TO  97.7  PERCENT 
MULTIPLIER  FOR  EFFICIENT  OUTPUT  LEVELS  =  1.144 

*********** 

*  OUTPUTS  * 

*********** 


OBSERVED 

EFFICIENT 

PERCENT 

VALUES 

OUTPUT 

CONTRIBUTION 

LEVELS 

TO  EFFICIENCY 

OUTPUT  B 

5527.0 

6323.3 

16.9 

OUTPUT  C 

13287.0 

15201 .4 

42.3 

OUTPUT  D 

6746.0 

7718.0 

5.2 

OUTPUT  8 

8810.8 

10080.3 

23.0 

TOTAL  :  87.4  PERCENT 


********** 

*  Inputs  * 
********** 


OBSERVED 

NO  INPUT 

RELATIVE 

VALUES 

CHANGES 

IMPORTANCE 

REQUIRED 

OF  INPUTS 

INPUT  1 

2736.0 

1  1  .9 

INPUT  3 

1 249.0 

.2 

INPUT  6 

39.0 

27.0 

INPUT  9 

98.0 

17.9 

INPUT  11 

29562.0 

43.0 

INPUT  13 

32.0 

.0 

INPUT  15 

1  29.0 

.0 

TOTAL :  100.0  PERCENT 
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In  the  case  of  multiple  output,  multiple  input 
analysis,  there  are  many  combinations  of  outputs  and  inputs 
that  an  organization  can  achieve.  One  organization  may  put 


more  effort  into  output  1 ,  while  another  may  emphasize 
output  3.  Therefore,  the  significance  of  a  variable  can 
only  be  determined  for  the  organization  being  evaluated. 

The  CFA  model  identifies  the  percent  contribution  to 
efficiency  for  the  output  variables,  and  relative  importance 
of  input  variables.  The  output  and  input  variables  with  the 
highest  percentages  are  the  most  significant  variables  for 
the  DMO  being  evaluated. 

Table  5.5  shows  the  Output  Change  Report  for  DMU  51. 

The  efficiency  range  for  DMU  51  is  similar  to  the  efficiency 
range  for  DMU  1 ,  yet  when  comparing  the  percent  contribution 
to  efficiency  for  the  output  variables  (See  Table  5.4)  there 
is  a  significant  difference  in  the  percentages  between  the 
two  units. 


TABLE  5.4 

Comparison  of  Variable  Significance 


Percent  Contribution 
to  Efficiency 

Output 

DMU  1 

DMU  51 

B 

16.9 

44.8 

C 

42.3 

.0 

D 

5.2 

41  .8 

1  .1 


8 


23.0 


TABLE  5.5 


Output  Change  Report  for  DMU  51 

i  _ 


MODEL  EFF  OF  AVAIL  RES 
DECISION  MAKING  UNIT  51 

********************** 

*  SUMMARY  OF  RESULTS  * 
********************** 


EFFICIENCY  RANGE  =  87.7  TO  94.8  PERCENT 

MULTIPLIER  FOR  EFFICINET  OUTPUT  LEVELS  =  1.141 


*********** 

*  OUTPUTS  * 
*********** 


OBSERVED  EFFICIENT 

VALUES  OUTPUT 

LEVELS 


PERCENT 
CONTRIBUTION 
TO  EFFICIENCY 


OUTPUT  B 
OUTPUT  C 
OUTPUT  D 
OUTPUT  8 


4615.0 

9916.0 

9593.0 

5735.0 


5264.2 
13711.6 
10942.5 
6541  .8 


44.8 
.0 
41  .8 
1  .1 


TOTAL:  87.7  PERCENT 


********** 

*  INPUTS  * 
********** 


OBSERVED 

NO  INPUT 

RELATIVE 

VALUES 

CHANGES 

IMPORTANCE 

REQUIRED 

OF  INPUTS 

INPUT  1 

1868.0 

23.4 

INPUT  3 

1316.0 

.0 

INPUT  6 

38.0 

36.4 

INPUT  9 

1  41  .0 

16.0 

INPUT  1 1 

29859.0 

.4 

INPUT  13 

1  1  .0 

9.1 

INPUT  15 

185.0 

14.6 

TOTAL:  100.0  PERCENT 


Both  units  were  able  to  achieve  approximately  the  same 
efficiency  rating,  while  putting  their  emphasis  on 
different  outputs.  The  significant  output  variables  for  DMU 
1  would  be  outputs  B,  C,  and  8,  whereas  the  significant 
variables  for  DMU  51  would  be  outputs  B  and  D. 

Research  Question  4 

"Can  tradeoffs  and  recommendations  be  found  which  allow 
inefficient  organizations  to  improve  their  efficiency?" 

The  CFA  efficiency  model  generates  two  reports,  the 
Output  Change  Report  and  Input  Change  Report,  for  each  DMU. 
The  information  from  the  reports  can  be  used  by  managers  to 
improve  their  efficiency  in  the  use  of  their  available 
resources.  Each  report  must  be  evaluated  separately  in 
order  for  resource  managers  to  determine  the  best  course  of 
action. 

Table  5.6  shows  a  typical  Output  Change  Report  for  the 
available  resource  efficiency  model.  In  comparison  with  the 
other  53  units  in  the  reference  set,  the  CFA  model 
determined  that  DMU  24  was  an  inefficient  unit.  The 
efficiency  rating  is  found  on  the  first  line  of  the  summary 
of  results.  The  Output  Change  Report  identifies  the  changes 
required  in  the  output  levels  to  make  the  unit  efficient 
while  keeping  the  inputs  at  the  same  levels.  The  efficient 
output  levels  are  determined  by  multiplying  the  observed 
output  values  by  the  multiplier  value  for  efficient  output 
and  subtracting  any  surplus, 
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that  may  be  present 


TABLE  5.6 


Output  Change  Report  for  DMU  24 


MODEL  EFF  OF  AVAIL  RES 
DECISION  MAKING  UNIT  24 

★  *★**★★*★*★*★★*★★*★*★'* 

*  SUMMARY  OF  RESULTS  * 
********************** 


EFFICIENCY  RANGE  =  88.3  TO  95.2  PERCENT 

MULTIPLIER  FOR  EFFICIENT  OUTPUT  LEVELS  *  1.132 


***★★***★★* 
*  OUTPUTS  * 


OBSERVED 

EFFICIENT 

PERCENT 

VALUES 

OUPUT 

CONTRIBUTION 

LEVELS 

TO  EFFICIENCY 

OUTPUT  B 

2018.0 

2284.2 

15.6 

OUTPUT  C 

16680.4 

18880.5 

29.2 

OUTPUT  D 

7635.2 

8642.3 

19.8 

OUTPUT  8 

10629.5 

12031.5 

23.7 

TOTAL: 

88.3  PERCENT 

★******★★★ 

*  INPUTS  * 

★***★*★**★ 

OBSERVED 

NO  INPUT 

RELATIVE 

VALUES 

CHANGES 

IMPORTANCE 

REQUIRED 

OF  INPUTS 

INPUT 

1 

1389.0 

8.9 

INPUT 

3 

2494.0 

.0 

INPUT 

6 

28.0 

22.8 

INPUT 

9 

97.0 

6.0 

INPUT 

1  1 

40167.5 

42.6 

INPUT 

1  3 

5.0 

.8 

INPUT 

15 

98.0 

18.8 

TOTAL :  100.0  PERCENT 


The  surplus  values  are  found  on  lines  3  and  6  of  each  data 
record  in  the  summary  file  (See  Appendix  E).  A  manager 
would  want  to  improve  output  levels  to  the  efficient  output 

levels  in  the  Output  Change  Report  in  order  to  become 

\ 

efficient. 

The  calculations  of  the  percent  contribution  to 
efficiency  for  the  output  variables  and  the  relative 
importance  of  inputs  was  discussed  for  Research  Questions  2 
and  3.  The  higher  the  percentage,  the  more  significance  the 
model  is  putting  on  an  output  or  input  variable.  Therefore, 
a  manager  would  want  to  put  efforts  into  improving  those 
variables  with  the  lowest  percentage  or  importance  since 
those  are  the  variables  that  are  contributing  the  least  to 
the  efficiency  of  the  unit. 

The  Input  Change  Report  determines  the  input  levels 
required  for  a  DMU  to  become  efficient  while  maintaining  the 
output  levels  at  their  current  values.  Like  the  output 
change  levels,  the  efficient  input  levels  are  calculated  by 
multiplying  the  observed  input  values  by  the  multiplier  for 
efficient  input  levels  and  subtracting  any  surplus,  .  A 

manager  would  again  emphasize  those  inputs  with  the  lowest 
relative  importance  since  they  are  detracting  from  the 
efficiency  of  the  DMU.  Table  5.7  is  an  example  of  an  Input 
Change  Report.  A  manager  would  first  put  efforts  on 
improving  input  3  in  order  to  improve  the  efficiency  of  his 


TABLE  5.7 


Input  Change  Report  for  DMU  24 


MODEL  EFF  OF  AVAIL  RES 
DECISION  MAKING  UNIT  24 

********************** 

*  SUMMARY  OF  RESULTS  * 

Hr********************* 

EFFICIENCY  RANGE  =  88.3  TO  95.2  PERCENT 

MULTIPLIER  FOR  EFFICIENT  INPUT  LEVELS  =  .883 

*********** 

*  OUTPUTS  * 
*********** 


OBSERVED 

NO  OUTPUT 

PERCENT 

VALUES 

CHANGES 

CONTRIBUTION 

REQUIRED 

TO  EFFICIENCY 

OUTPUT 

B 

2018.0 

15.6 

OUTPUT 

C 

16680.4 

29.2 

OUTPUT 

D 

7635.2 

19.8 

OUTPUT 

8 

10629.5 

23.7 

TOTAL: 

88.3  PERCENT 

********** 

*  INPUTS  * 

********** 

OBSERVED 

EFFICIENT 

RELATIVE 

VALUES 

INPUT 

IMPORTANCE 

LEVELS 

OF  INPUTS 

INPUT 

1 

1389.0 

1227.1 

8.9 

INPUT 

3 

2494.0 

2067.8 

.0 

INPUT 

6 

28.0 

24.7 

22.8 

INPUT 

9 

97.0 

85.7 

6.0 

INPUT 

1 1 

40167.5 

35486.8 

42.6 

INPUT 

1  3 

5.0 

4.4 

.8 

INPUT 

1  5 

98.0 

86.6 

18.8 

TOTAL :  100.0  PERCENT 


Following  the  Output  Change  Report  and  Input  Change 
Report,  the  CFA  model  provides  a  list  of  efficient  units 
that  make  up  the  efficiency  frontier  closest  to  the 
inefficient  unit.  Table  5.8  shows  the  list  of  the 
efficiency  frontier  units  for  DMU  24,  Howard  3.  The  units 
identified  in  this  set  have  a  similar  mix  of  outputs 
and  inputs  as  the  inefficient  unit.  A  manager  would  study 
these  efficient  units  and  attempt  to  model  his  unit  after 
the  efficient  units. 


TABLE  5.8 


Efficiency  Frontier  for  DMU  24 


X 

NELLIS1 

.19615 

X 

HOWARD 1 

.64446 

X 

MOODY1 

.34292 

X 

GEORGE 3 

-.25442 

X 

BERGSTR0M3 

-.25695 

X 

SEY  JOHN 2 

-.01498 

X 

LUKE  3 

.10689 

X 

MACD ILL 3 

.04753 

X 


M00DY2 


.11858 


The  CFA  efficiency  model  also  provides  Output  and  Input 
Change  Reports  for  the  efficient  units.  Table  5.9  is  an 
example  of  an  Input  Change  Report  for  an  efficient  unit.  If 
a  unit  has  been  identified  as  an  efficient  unit,  there  are 
no  required  changes  in  the  output  or  input  levels.  Even 
though  there  are  no  required  changes  in  the  output  and  input 
levels,  there  is  information  to  be  gained  from  these  reports 
for  the  efficient  units. 

In  the  case  of  DMU  4  in  Table  5.9,  it  was  identified  as 
an  efficient  unit,  yet  100  percent  of  the  contribution  to 
efficiency  came  from  output  8,  indirect  manhours.  A  manager 
may  evaluate  this  result  and  determine  that  even  though  his 
unit  was  determined  to  be  efficient,  too  much  emphasis  was 
being  placed  on  one  output. 

The  same  principle  holds  true  for  the  relative 
importance  of  the  input  values.  A  manager  would  want  to 
investigate  those  inputs  that  have  little  or  no  relative 
importance  to  determine  if  the  inefficiencies  are  being 
covered  up  by  the  more  significant  values. 

The  reports  generated  by  the  CFA  efficiency  model 
provide  a  lot  of  information  that  can  be  used  by  managers  to 
more  efficiently  operate  their  unit.  The  information 
allows  the  manager  to  make  tradeoffs  between  inputs  and 
outputs,  and  provides  many  alternative  courses  of  action. 
Information  is  not  only  available  for  the  inefficient  units, 
but  also  for  efficient  units.  A  manager  must  evaluate  the 


TABLE  5.9 


Input  Change  Report  for  an  Efficient  Unit 

_ 


MODEL  EFF  OF  AVAIL  RES 
DECISION  MAKING  UNIT  4 

*  SUMMARY  OF  RESULTS  * 

★  ★★★★★★★★★★★★Hr******** 

EFFICIENCY  RANGE  »  100.0  TO  100.0  PERCENT 

MULTIPLIER  FOR  EFFICIENT  INPUT  LEVELS  *  1.000 

*★★*★***★** 

*  OUTPUTS  * 

★★**★★★★*** 


OBSERVED 

NO  OUTPUT 

PERCENT 

VALUES 

CHANGES 

REQUIRED 

CONTRIBUTION 

TO  EFFICIENCY 

OUTPUT  B 

332.5 

.0 

OUTPUT  C 

5808.5 

.0 

OUTPUT  D 

3845.8 

.0 

OUTPUT  8 

10649.9 

TOTAL : 

★**★*★*★** 

*  INPUTS  * 
**★★*★*★*★ 

100.0 

100.0  PERCENT 

OBSERVED 

EFFICIENT 

RELATIVE 

VALUES 

INPUT 

LEVELS 

IMPORTANCE 

OF  INPUTS 

INPUT  1 

2526.0 

2526.0 

.0 

INPUT  3 

1561 .0 

1 561.0 

.0 

INPUT  6 

9.0 

9.0 

90.2 

INPUT  9 

1  39.0 

1  39.0 

.0 

INPUT  11 

23992.0 

23992.0 

1  .4 

INPUT  13 

7.0 

7.0 

7.0 

INPUT  15 

137.0 

137.0 

1  .4 

TOTAL 


100.0 


results  for  his  unit  and  then  base  appropiate  actions  on  the 
unique  characteristics  of  his  unit. 


The  number  of  outputs  and  inputs  selected  also  affects 
the  number  of  units  identified  as  efficient  or  inefficient. 
Table  5. 10  shows  a  comparison  of  the  number  of  output  and 
inputs  selected.  As  fewer  variables  are  used  in  the 
efficiency  model,  the  size  of  the  efficiency  frontier 
becomes  smaller,  thus  reducing  the  number  of  units  that  can 
reach  the  efficiency  frontier. 


TABLE  5.10 

Comparison  of  Outputs  and  Inputs  Selected 


Ratio  of  Number 

Number  Number  Observations  of 

of  of  to  Outputs  Inefficient  Percent 

Outputs  Inputs  Total  and  Inputs  *  Units  Efficient 


VI.  Conclusions  and  Recommendations 


Introduction 

This  chapter  presents  the  conclusions  based  on  the 
results  from  the  model  developed  to  measure  the  efficient 
use  of  available  resources  in  the  Operations  Branch  of  a 
base  level  civil  engineering  organization.  The  limitations 
of  the  CFA  efficiency  model  were  discussed  in  the  previous 
chapters.  The  effects  of  the  model  limitations  will  be 
presented  in  the  chapter  along  with  recommendations  to 
improve  the  efficiency  model  for  available  resources. 

Specific  Conclusions 

McKnight  and  Parker  (1983)  initiated  a  research  effort 
to  develop  an  organizational  effectiveness  model  for  base 
level  civil  engineering  organizations.  Their  research 
effort  generated  a  nine-factor  effectiveness  model  based  on 
inputs  from  wing,  base,  and  civil  engineering  commanders. 
They  concluded  with  recommendations  to  further  develop  the 
model  by 

1 .  Standardize  definitions  for  each  of  the  nine 
factors. 

2.  Develop  measurement  criteria. 

3.  Test  and  validate  the  model  for  use  by  base  civil 
engineers  at  CONUS  Air  Force  installations. 

The  objective  of  this  research  effort  was  to  accomplish 
these  three  tasks  for  Factor  4,  Resource  Availability,  of 


the  organizational  effectiveness  model.  The  use  of 
available  resources  was  perfectly  suited  for  developing  an 
efficiency  model.  The  use  of  resources  provides  a 
quantitative  measure  that  can  be  evaluated  in  a  mathematical 
model.  The  specific  conclusions  from  this  research  effort 
are  discussed  below: 

1 .  A  standardized  set  of  measurement  criteria  was  developed 
for  modeling  the  efficient  use  of  available  resources.  The 
list  of  measures  was  based  on  current  base  level  civil 
engineering  procedures.  From  a  list  of  46  candidate 
measures,  a  set  of  output  and  input  measures  were  developed 
to  measure  efficient  use  of  available  resources  in  the 
Operations  Branch.  Table  4.1,  page  61,  and  Table  4.2, 

page  65,  list  the  output  and  input  measures  selected  to 
describe  the  use  of  available  resources. 

2.  Data  was  collected  from  the  18  Tactical  Air  Command 
bases  for  a  three  month  time  frame.  Each  base  submitted  the 
data  for  the  required  output  and  input  measures.  Each  base 
had  three  months  of  data  representing  three  observations  for 
the  efficiency  model. 

3.  The  54  data  observations  were  used  in  the  Constrained 
Facet  Analysis  model  at  the  University  of  Texas,  Austin  to 
determine  if  the  effcient  use  of  available  resources  could 
be  modeled.  Due  to  CFA  program  code  limitations,  the 
complete  set  of  8  output  and  1 6  input  measures  could  not  be 
used.  The  set  of  measures  was  reduced  by  aggregating  the 


output  measures  into  4  outputs  and  reducing  the  input 
measures  to  a  set  of  7  inputs.  The  input  measures  in  the 
final  selection  were  based  on  results  from  a  Pearson 


Correlation  executed  on  the  data  file  of  outputs  and  inputs. 
The  final  set  of  measures  was  then  executed  in  the  CFA 
program.  The  CFA  model  did  provide  efficiency  ratings  for 
the  data  observations.  Appendix  E  provides  a  summary  of  the 
efficiency  ratings,  multiplier  values,  and  surplus  values 
for  the  54  observations  in  the  data  set.  Tables  5.3  -  5.9 
are  examples  of  the  Output  Change  Reports  and  Input  Change 
Reports  generated  for  the  inefficient  and  efficient  units. 
The  reports  generated  by  the  model  provided  information  on 
the  significance  of  output  and  input  variables,  and 
identified  areas  where  improvements  could  be  made  which 
would  allow  inefficient  units  to  achieve  an  efficient 
rating.  The  model  also  provided  the  inefficient  unit  with  a 
list  of  efficient  units  that  made  up  the  efficiency  frontier 
closest  tho  the  inefficient  unit.  The  units  identified  had 
similar  mixes  of  outputs  and  inputs  as  the  inefficient 
units. 

Effects  of  CFA  Program  Limitations 

As  stated  in  Chapter  5,  an  unforseen  problem  arose  with 
the  CFA  programming  code.  The  CFA  model  was  ony  able  to 
execute  on  data  with  less  than  20  output  and  input 
variables.  Due  to  these  limitations,  the  set  of  24  output 


and  input  measures  had  to  be  reduced.  Reducing  the  measures 
used  in  the  efficiency  model  affected  the  description  of 
the  process  being  measured.  Since  all  of  the  measures  could 
not  be  included  in  the  model,  a  complete  description  of  the 
process  was  not  being  modeled.  This  lack  of  description  of 
the  process  being  modeled  affected  the  information  produced 
by  the  efficiency  model.  In  order  to  correctly  identify  all 
the  inefficiencies  within  an  organization,  the  complete 
description  of  the  process  being  modeled  must  be  present  in 
the  efficency  model. 

The  CFA  model  is  also  limited  in  the  number  of 
inefficient  units  identified  when  using  a  large  set  of 
output  and  input  measures  compared  to  a  relatively  small  set 
of  oservations.  The  model  recommends  a  ratio  of 
observations  to  number  of  outputs  and  inputs  of  2  to  1 .  The 
CFA  program  code  limited  the  number  of  output  and  inputs 
used  in  the  model  to  less  than  20,  yet  when  only  18  output 
and  input  measures  were  used  with  the  54  observations,  only 
5  units  were  identified  as  inefficient.  Table  5.10  shows  the 
ratio  of  observations  to  output  and  input  measures,  and  the 
number  of  inefficient  units  identified  for  different 
combinations  of  output  and  input  measures.  Further  research 
in  this  area  should  take  into  account  the  limitations 
imposed  when  large  sets  of  output  and  input  measures  are 
used  with  a  small  set  of  observations. 


Recommendations 


This  research  effort  has  shown  that  the  CFA  model  can 
be  used  to  model  the  efficient  use  of  available  resources  in 
the  Operations  Branch  of  a  base  level  civil  engineering 
organization.  The  following  specific  recommendations  are 
offered  for  further  consideration. 

1 .  Redimension  the  CFA  computer  program  code  to  a 
dimension  greater  than  20.  By  accomplishing  this  task  the 
entire  set  of  output  and  input  variables  could  be  used  in 
the  efficiency  model.  The  CFA  model  theory  will  work  for  a 
model  with  more  than  20  output  and  input  variables,  but  the 
current  CFA  computer  program  limits  the  number  of  variables 
that  can  be  used. 

2.  Collect  data  from  all  CONUS  Air  Force 
installations.  By  collecting  data  from  all  CONUS  bases,  the 
number  of  observations  in  the  data  file  can  be  increased. 
Comparisons  can  then  be  made  between  units  in  various 
commands  or  by  isolating  just  one  set  of  bases.  The  CFA 
executive  commands  allow  flexibility  in  the  selection  of 
units  to  be  evaluated  in  the  reference  set,  and  in  the 
selection  of  units  to  be  processed. 

3.  Collect  data  on  all  measures  in  the  candidate  list 
of  output  and  input  variables.  A  Pearson  Correlation  can 
then  be  executed  on  all  measures  to  determine  which 
variables  are  best  suited  for  measuring  available  resources. 
Again,  the  CFA  executive  commands  provide  the  flexibility 
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of  selecting  a  subset  of  output  and  input  measures 


4.  Instead  of  using  manhours  completed  in  the  various 
output  processes,  a  more  appropriate  measure  of  output  may 
be  the  original  set  of  10  output  measures  discussed  in 
Chapter  3.  As  stated  in  Chapter  4,  the  output  measures 
selected  are  actually  process  measures,  not  results 
measures.  The  manhour  data  should  be  used  as  input 
variables  for  the  efficiency  model.  Data  could  be  easily 
collected  on  the  number  and  cost  of  work  orders  and  job 
orders  being  completed  at  CONUS  installations.  The  author 
believes  that  this  data  would  provide  a  better  description  of 
the  output  for  a  unit  and  would  better  identify  those  units 
that  are  efficient.  It  would  identify  those  units  that  have 
higher  personnel  productivity  levels. 

A  study  could  also  be  conducted  which  compares  the 
variation  of  manhours /work  order  between  the  observations  in 
the  data  file.  If  the  standard  deviation  of  manhours/work 
order  is  small,  then  assumptions  could  be  made  that  the 
number  of  work  orders  accomplished  per  month  is  not  greatly 
affected  by  the  size  of  the  work  orders  for  a  particular 
base.  The  same  approach  could  be  used  when  comparing  the 
variation  of  manhours/job  order  between  observations.  If 
little  variation  exists  between  observations,  then  data  on 
the  number  of  work  orders  and  job  orders  being  completed  can 
be  used  to  measure  the  output  for  a  civil  engineering  unit. 
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5.  The  CFA  efficiency  model  can  be  used  to  measure  the 
efficiency  of  other  areas  of  a  civil  engineering  unit. 
Current  research  efforts  are  being  conducted  to  determine 
the  efficiency  of  base  level  civing  engineering  Fire 
Departments  (Byers  and  Waylett,  1984),  and  Engineering 
Design  (Astin  and  Ruff,  1984).  Further  research  efforts 
should  concentrate  on  modeling  the  efficiency  of  other  areas 
of  civil  engineering  organizations.  Once  all  research  is 
completed,  the  CFA  model  could  be  used  Air  Force  wide  to 
model  the  efficiency  of  civil  engineering  organizations. 

The  CFA  model  could  also  be  used  to  compare  subunits  within 
civil  engineering.  For  example,  a  model  could  be  developed 
to  compare  the  different  shops  in  the  Operations  Branch  of  a 
civil  engineering  unit. 

6.  Once  the  model  is  operational  for  all  applicable 
inputs  and  outputs,  implement  the  CFA  efficiency  model  as  a 
management  tool  to  be  used  by  Air  Force  civil  engineering 
managers  to  improve  the  efficiency,  and  thus,  the 
productivity  and  effectiveness  of  base  level  civil 
engineering  organizations. 


Appendix  A:  Model  Used  in  Constrained  Facet  Analysis 

of  Not  Fully  Enveloped  Units 


The  model  used  in  the  iterative  method  called 
constrained  facet  analysis  is  presented  in  this  appendix,  a 
model  which  can  be  used  in  evaluating  the  range  of 
inefficiency  in  organizational  units  and  in  determining 
marginal  rates  of  substitution  and  productivity  in  frontier 
facets. 

Suppose  one  wishes  to  evaluate  the  relative  efficiency 
of  n  decision  making  units  (DMUs),  each  of  which  uses 
varying  amounts  of  m  inputs  and  produces  varying  amounts  of 
s  outputs.  Using  notation  conventions  similar  to  those  used 
by  Clark  (1982)  let: 


=  the  amount  of  input  type  i  used  by  DMU  j  during 
the  period  of  observation,  i  =  1,  2,...,m  and 
j  s  1,  2, . . . ,n. 


y  r j  *  the  amount  of  output  type  r  produced  by  DMU  j 

during  the  period  of  observation, 
r  a  1,  2  , . . . ,  s  and  3  ™  1,  2,...,n. 


x  ik  =  the  amount  of  input  type  i  used  by  the  unit  k 
where  k  j  =  1,  2,...,k,...,n  and  unit  k  is 

the  DMU  being  evaluated.  Each  DMU  in  turn  will 
be  evaluated. 


y  rk  =  the  amount  of  output  type  r used  by  DMUk. 


N  a  1 ,  2 ,  3 , . . . ,M  is  the  sequence  of  iterations  of 
the  constrained  facet  analysis  model  which  ends 
at  iteration  M. 


hlc'1' 


=  the  upper  bound  efficiency  value  sought  for  DMUk 
which  is  determined  from  the  solution  of  the 
first  iteration  of  the  constrained  facet 
analysis. 1 


hk^M*  =  the  lower  bound  efficiency  value  sought  for  DMUk 
which  is  determined  from  the  solution  of  the 
final  iteration  (M)  of  the  constrained  facet 
analysis . 

Vi4»)  =  the  multipliers  for  each  input  type  i  which 
will  be  determined  by  solution  of  the  Nth 
iterative  model. 

=  the  multipliers  for  each  output  type  r  which 
will  be  determined  by  solution  of  the  Nth 
iterative  model. 

sriN~1 **=  the  dual  surplus  values  associated  with  outputs 
r  =  1,  2,...,s  of  DMUk  at  optimality  of  the 
previous  iteration.  For  the  initial  iteration, 

these  surplus  values  are  srk(N_1  )*»  s rk (°)* 

=  Yrk- 

si]^N-1^*=  the  dual  surplus  values  associated  with  inputs 
i  =  1,  2,...,m  at  optimality  of  the  previous 
iteration.  Initial  values  at  iteration  one  are 
sik^1**  =  sik<0>*  =  xik. 


The  form  of  the  constrained  facet  analysis  model  used  in 
the  first  iteration  is  similar  to  the  Data  Envelopment 
Analysis  (DEA)  model  of  Charnes,  Cooper  and  Rhodes  (19 
however  the  non-Archimedean  infinitesimal  quantities  are 
not  required. 


The  following  linear  programming  model  is  used  in 
constrained  facet  analysis  for  each  iteration 
N  =  1  ,  2, - M: 


Primal 


«>»  fk<»>  -  l  Urt«»>stk<»-D*  •.  I  vik(H)sik<»-D* 
r*l  i«l 


m 


s.t. 


I  ^rk(N)yrj  '  I  vik(N>xij  “  0  for  jeEk(N) 
r=l  i=l 


r-1 


m 

l 

i=l 


l  Urk(N)yrj  '  l  vik(N)xij  i  0  for  3£Ek(N) 


m 


I  Vik<N)xik  -  1 

i=l 


Urk(N,»  vik(N)  >  0 


where 


Ek^N^  ~  tj/jth  constraint  holds  with  equality  at 
optimality  at  iteration  N-1 } 

Ek<N)  =  {j/jth  constraint  is  <  0  at  optimality  of 
iteration  N-1 } 


E]^1)  =  4>  (empty),  =  {1,  2,...,n}. 


The  upper  and  lower  bound  efficiency  measures  are 
obtained  from  solution  of  the  first  and  last  iterative 
models  as  shown  below: 

hk(1 )  *  fk(1 }  "  1  ■  l  ^rk(1)*Yrk 

r=1 

hk(M)  ■  l  yrk(M)*Yrk 
r=1 


The  dual  of  model  (1)  above  is: 


Dual 


Min 


s.t. 


jCE 


jeg<N> 


srk 


(N~l ) 1 


r  *  1,2,  ...,s 


■urt.""-  L„,  V’mj 

j£E(N)  j£E(N) 


*ik 


!ik 


(N-l )* 


i  *  1, 2, . . . ,m 


s.JN)  >  0 


u,V<N>  X,<n>  unrestricted; 


The  mathematical  theory  and  proofs  related  to  the 
development  of  this  model  can  be  found  in  Clark  (1982).  They 
will  not  be  repeated  in  this  paper,  but  there  are  a  few 
model  characteristics  which  are  worth  noting  here. 

First,  the  efficiency  measures  hk^^  and  h^^)  are 
scalar  ratio  measures.  Secondly,  the  constraints  of  the 
primal  problem  insure  that  the  maximum  achievable  value  of 
these  efficiency  measures  is  1 .  Furthermore,  constrained 
facet  analysis  does  not  require  that  outputs  or  inputs  have 
common  scales  or  units  of  measurement,  an  important 
attribute  when  dealing  with  difficulties  such  as  nonmonetary 
objectives  and  nonpurchased  resources,  however;  all  measured 
input  and  output  values  are  required  to  be  strictly 
positive.  Finally,  each  unit  is  compared  to  others  in  the 
set  which  have  similar  input/output  mixes,  i.e.,  those  units 
in  its  "neighborhood". 

In  short,  the  constrained  facet  analysis  model  can 
identify  units  which  are  efficient  or  inefficient  relative 
to  a  neighborhood  frontier  region  of  actual  achievement;  it 
can  provide  a  limited  number  of  clues  on  possible  causes 
from  analysis  of  surplus  variables  and  multipliers;  and  it 
is  helpful  in  evaluating  the  impact  of  alternative  mixes  of 
inputs  and  outputs. 

Furthermore,  the  information  provided  by  the 
constrained  facet  analysis  model  is  a  major  improvement  over 
the  inadequate,  partial  {and  sometimes  inaccurate)  measures 


of  performance  which  are  now  typically  in  use  in  many  public 
service  organizations.  In  addition  to  its  usefulness  as  a 
performance  monitoring  device,  this  efficiency  analysis  tool 
opens  the  door  for  further  development  and  growth  in  other 
areas  of  planning,  resource  allocation  and  decision  support. 


"Constrained  Facet  Analysis,  A  New 
Method  for  Evaluating  Local  Frontiers 
of  Efficiency  and  Performance" 

(Bessent,  Bessent,  Clark,  and  Elam;  1983) 


Reprinted  from: 


Appendix  B:  Bases  Used  in  Research 


Tactical  Air  Command  Bases 

1 .  Bergstrom 

2 .  Cannon 

3.  Davis  Monthan 

4.  England 

5 .  George 

6.  Holloman 

7.  Homestead 

8 .  Howard 

9.  Langley 

10.  Luke 

11.  MacDill 

1 2 .  Moody 

13.  Mountain  Home 

14.  Myrtle  Beach 

15.  Nellis 

1 6 .  Seymour  Johnson 

17.  Shaw 

18.  Tyndall 
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Appendix  F:  Lambda  File 


18EHGSTRUMI  LUKE3  -.03192 

2HERGSTR0M1  DAVIS  MQN3  .22045 
3BEHGSTR0M1  dEHGSTR0M3  .81875 
48ERGSTRQM1  MOODY  I  .25666 

50ERGSTR0MI  SEY  JGHN2  -.04214 
60ERG3TRUM1  NELLIS1  -.04663 
78EHGSTR0M1  H0WARD1  -.00217 
88ERGS  TRQM1  M00DY2  -.38271 

1BERGSTR0M2  MYRTLE  82  -.04002 

2BERGSTR0M2  BERGSTR0M3  .95292 
38ERGSTR0M2  LUKE  1  .66141 

4HERGSTRQM2  M00DY2  .29833 
58ERGSTR0M2  OAVIS  M0N2  -.11991 
6BERGSTR0M2  SEY  J0HN2  .03731 
7HERGSTROM2  LUKE2  -.55460 

88tRGSTr<0M2  M00DY1  -.19451 

9RERGSTR0M2  GE0RGE3  -.12698 
10BERGSTROM2  M  H0ME3  .00677 

1  CANN0N2  H0*AR01  .64705 

2  CANN0N2  SEY  J0HN2  -.03516 

3  CANN0N2  NELLIS1  .70974 

4  CANMUN2  H0MESTEAD3  -.73102 

5  CANN0N2  H0MESTEAD2  .09103 

6  CANNUN2  LUKE3  -.10330 

7  CANN0N2  MAC0ILL3  -.05923 

6  CANN0M2  MOODY  1  .17967 

1  CANN0N3  NELL  I S2  .95212 

2  CANN0N3  HO^AROl  .78572 

3  CANNUN3  NELL  IS  1  -.34992 

4  CANN0N3  SEY  J0HN2  -.15487 

5  CANNUN3  MOODY  1  -.12687 

6  CANNONS  DAVIS  MUN3  -.36389 

7  CANN0N3  MACDILL3  -.lt79d 

6  CANN0N3  M00DY2  .16174 


1 

englanoi 

SEY  JUHN2 

-,084bo 

2 

englanoi 

HOLLOMAN! 

.26596 

3 

ENGLAND! 

MOODY  1 

-.13771 

4 

englanoi 

NELLIS! 

.  (A  1  4  45 

s 

ENGLANOI 

LUKE  3 

-.0922b 

6 

englanoi 

LANGLEY1 

.63421 

7 

englanoi 

OAVIS  MON 1 

-.04082 

b 

englanoi 

OAVIS  MON3 

- .33654 

1 

ENGLAN02 

OAVIS  MQN3 

-.46773 

2 

ENGLAN02 

SEY  JOHN  1 

2.95747 

3 

ENGLAN02 

HOLLOMAN1 

.31279 

4 

ENGLAN02 

MACDILL3 

.53210 

5 

ENGLAND2 

NELLIS! 

1 .14943 

b 

EnGL An02 

LUKE1 

-1.77777 

7 

ENGLAN02 

HOWARD  1 

-.15182 

6 

ENGLAN02 

SEY  J0HN2 

-2.33425 

9 

ENGLAND2 

LUKE3 

-.12902 

1 

ENGLAN03 

hollomani 

-.18620 

2 

ENGLAND3 

MACOILL3 

.32067 

3 

ENGLAN03 

MOODY  1 

.79730 

4 

ENGLAN03 

SEY  JOHN2 

,1049b 

5 

ENGLAND3 

GEORGE! 

1.36342 

6 

ENGLAN03 

GEOHGE3 

-.88903 

7 

ENGLAND3 

C ANNON1 

-.05454 

8 

ENGLAND3 

MOOOY2 

-.84348 

9 

ENGLAN03 

HOWARD  1 

.00697 

1 

HULL0MAN3 

SH  Aw  1 

.07597 

2 

HOLLOMAN3 

HOLLOMANI 

.7572b 

3 

HOLLUMAN3 

SEY  JOHN 1 

-.21076 

4 

MOLLOMAN3 

OAVIS  MON3 

,o3ol5 

5 

MOLLUMAN3 

HOWARD1 

.16477 

b 

MOLLOMAN3 

SEY  JOHN2 

.20915 

7 

hOLLOMAN3 

LOKEl 

,1317b 

tt 

M0LLUMAN3 

MAC0ILL3 

-.00094 

9 

HOLLOMAN3 

MOOOY2 

,45184 

10 

HOLLOMAN3 

MOODY  1 

-.56387 

IHUMESTfcADl 

NELL  151 

.05093 

2HUM&STEAIU 

MACOILL1 

.03705 

3H0MtST£ADl 

HOMES  T£  AD2 

.47089 

4HUM£STfcA0i 

SEY  JOHN2 

.24315 

b nOMgs T  £ AO  1 

HOWARD! 

.12559 

©HUMfcSTEAOl 

MACOILL3 

.08999 

1 

HOWAH03 

NELL  IS  1 

.19015 

2 

HfjwAKDi 

HOwAKOl 

.0444o 

3 

nOflAKD3 

MOtJU  Y  t 

.34292 

4 

MOW AWD3 

GECH&E3 

-.25442 

5 

HOrt A«03 

oEHGJl KUM3 

-.25095 

b 

MQw  AkL>3 

St.r  Jumn2 

-.oiu9e 

7 

HMw  AWI)  J 

LUKEi 

.  ll’0«9 

0 

rtf'w  AkD3 

MACOILL3 

.  J4753 

9 

nilwANOi 

MOODY  £ 

. 1 1 85n 

1 

LANGLEYS 

MOOD Y 1 

-.25564 

2 

LAMGLEY2 

DAVIS  M0N2 

-,5459b 

3 

LANGLEY2 

LUKF.3 

3.91750 

4 

LANGLEY2 

DAVIS  M0N3 

,99b3b 

S 

LANGLEYS 

TYNDALL3 

2.0879b 

6 

LANGLEYS 

LUKE2 

-2.51912 

7 

LANGLEYS 

HOLLOMANl 

.34163 

8 

LANGLEYS 

MACDILL3 

-2.11bl8 

9 

LANGLEYS 

NELLIS1 

-.83943 

ltd 

L ANGLE  Y  2 

SEY  J0HN2 

.36574 

1 

LANGLEY 3 

SEY  JOHN 2 

.00831 

2 

LANGLEY  3 

HOWARD1 

1.82161 

3 

LANGLEY3 

dEHGSTHOM3 

2.S2765 

4 

LANGLEY3 

MOODY  1 

-.73807 

5 

LANGLEY  3 

DAVIS  M0N2 

.42330 

o 

LANGLEY3 

M  H0ME3 

.77318 

7 

LANGLEY3 

M0UDY2 

-2.04088 

b 

LANGLEY3 

HUMESTEAD3 

-.61110 

9 

LANGLEY3 

TYNDALL3 

-.44933 

10 

LANGLEY  3 

LUKE3 

-.76681 

1 

NELL1S3 

SEY  J0HN2 

-.77665 

2 

NELLIS3 

MELLIS1 

-1.41864 

3 

NELLIS3 

NELLIS2 

2.99213 

4 

NELLIS3 

HOWARD  1 

.80952 

5 

NELLIS3 

CANNONl 

-1.29278 

b 

NELLIS3 

M00DY2 

1.26176 

7 

NELL1S3 

DAVIS  M0N3 

-.80873 

s 

NELLIS3 

MAC0ILL3 

.11532 

1 

SHArti 

HOWARD  1 

-.21488 

2 

SMA*3 

SEY  J0HN3 

1  ,b3479 

3 

Sha«3 

GE0KGE3 

.74479 

4 

SHA/*3 

SHArtS 

.11387 

5 

SHAW  3 

SEY  JUHN2 

-1.21667 

6 

SHArt3 

MACDILL3 

-.19170 

7 

5  H  A  w  3 

LUKE3 

-.02049 

a 

5  H  A  w  3 

SH  Art  1 

-.05340 
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